Apr 14 01:14:05 devstack cinder-volume[72164]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 14 01:14:05 devstack cinder-volume[72164]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 14 01:14:05 devstack cinder-volume[72164]: we strongly recommend against using it for new projects.
Apr 14 01:14:05 devstack cinder-volume[72164]: If you are already using Eventlet, we recommend migrating to a different
Apr 14 01:14:05 devstack cinder-volume[72164]: framework.  For more detail see
Apr 14 01:14:05 devstack cinder-volume[72164]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 14 01:14:05 devstack cinder-volume[72164]:   import eventlet  # noqa
Apr 14 01:14:07 devstack cinder-volume[72164]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72164) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 14 01:14:07 devstack cinder-volume[72164]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72164) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 14 01:14:07 devstack cinder-volume[72164]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72164) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 14 01:14:07 devstack cinder-volume[72164]: INFO dbcounter [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Registered counter for database cinder
Apr 14 01:14:07 devstack cinder-volume[72164]: DEBUG oslo_db.sqlalchemy.engines [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG dbcounter [-] [72164] Writer thread running {{(pid=72164) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 14 01:14:08 devstack cinder-volume[72164]: INFO cinder.rpc [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 14 01:14:08 devstack cinder-volume[72164]: INFO cinder.rpc [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_db.sqlalchemy.engines [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 14 01:14:08 devstack cinder-volume[72164]: INFO cinder.volume.manager [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Determined volume DB was empty at startup.
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG cinder.volume.manager [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72164) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 14 01:14:08 devstack cinder-volume[72164]: INFO cinder.volume.manager [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 14 01:14:08 devstack cinder-volume[72164]: WARNING stevedore.named [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 14 01:14:08 devstack cinder-volume[72164]: WARNING castellan.key_manager [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 14 01:14:08 devstack cinder-volume[72164]: WARNING cinder.keymgr.conf_key_mgr [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG cinder.volume.drivers.lvm [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72164) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_concurrency.processutils [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72164) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_concurrency.processutils [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] CMD "cinder-rtstool verify" returned: 0 in 0.231s {{(pid=72164) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_db.sqlalchemy.engines [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 14 01:14:08 devstack cinder-volume[72164]: INFO cinder.rpc [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 14 01:14:08 devstack cinder-volume[72164]: INFO cinder.rpc [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 14 01:14:08 devstack cinder-volume[72164]: WARNING stevedore.named [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 14 01:14:08 devstack cinder-volume[72164]: WARNING castellan.key_manager [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 14 01:14:08 devstack cinder-volume[72164]: INFO cinder.volume.manager [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_db.sqlalchemy.engines [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 14 01:14:08 devstack cinder-volume[72164]: INFO oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Starting 1 workers
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Started child 72266 {{(pid=72164) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Full set of CONF: {{(pid=72164) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] ******************************************************************************** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Configuration options gathered from: {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] ================================================================================ {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 14 01:14:08 devstack cinder-volume[72266]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] allow_availability_zone_fallback = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] allow_compression_on_image_upload = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] allowed_direct_url_schemes     = [] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] api_rate_limit                 = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] auth_strategy                  = keystone {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] az_cache_duration              = 3600 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_availability_zone      = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_host                   = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_name                   = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_stats_polling_interval = 60 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backup_api_class               = cinder.backup.api.API {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backup_name_template           = backup-%s {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backup_use_same_host           = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backup_use_temp_snapshot       = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] chap_password                  = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] chap_username                  =  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cinder_internal_tenant_project_id = 029a4b65e91b4bafb453b33dfeff2d5f {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cinder_internal_tenant_user_id = c144d19d9ee849d2899eda36a0c301b7 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cloned_volume_same_az          = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cluster                        = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] compression_format             = gzip {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] config_dir                     = [] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] config_source                  = [] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] control_exchange               = openstack {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] debug                          = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] default_availability_zone      = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] default_group_type             = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] default_volume_type            = lvmdriver-1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] disk_geometry                  = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] driver_client_cert             = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] driver_client_cert_key         = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] driver_data_namespace          = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] driver_ssl_cert_path           = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] driver_ssl_cert_verify         = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] driver_use_ssl                 = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] enable_force_upload            = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] enable_new_services            = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] enable_unsupported_driver      = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] enforce_multipath_for_image_xfer = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] filter_function                = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance_api_insecure            = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance_api_servers             = ['http://192.168.122.48/image'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance_api_ssl_compression     = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance_ca_certificates_file    = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance_certfile                = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72266]: INFO cinder.volume.manager [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance_keyfile                 = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance_num_retries             = 3 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance_request_timeout         = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] goodness_function              = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] graceful_shutdown_timeout      = 5 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] group_api_class                = cinder.group.api.API {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] host                           = devstack {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] image_compress_on_upload       = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] image_conversion_address_space_limit = 1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] image_conversion_cpu_limit     = 60 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] image_conversion_disable       = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] image_upload_use_cinder_backend = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] image_upload_use_internal_tenant = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] image_volume_cache_enabled     = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] image_volume_cache_max_count   = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] image_volume_cache_max_size_gb = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] init_host_max_objects_retrieval = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] iscsi_target_flags             =  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] iscsi_write_cache              = on {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] iser_helper                    = tgtadm {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] iser_ip_address                = 192.168.122.48 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] iser_port                      = 3260 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] log_color                      = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] log_config_append              = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] log_dir                        = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] log_file                       = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] log_options                    = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] log_rotate_interval            = 1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] log_rotate_interval_type       = days {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] log_rotation_type              = none {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] max_age                        = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] max_logfile_count              = 30 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] max_logfile_size_mb            = 200 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] max_over_subscription_ratio    = 20.0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] message_reap_interval          = 86400 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] message_ttl                    = 2592000 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] migration_create_volume_timeout_secs = 300 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] monkey_patch                   = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] monkey_patch_modules           = [] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] my_ip                          = 192.168.122.48 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] no_snapshot_gb_quota           = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] num_iser_scan_tries            = 3 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] num_shell_tries                = 3 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] num_volume_device_scan_tries   = 3 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] nvmeof_conn_info_version       = 1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] nvmet_ns_id                    = 10 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] nvmet_port_id                  = 1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] osapi_max_limit                = 1000 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] osapi_volume_ext_list          = [] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] osapi_volume_listen_port       = 8776 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] osapi_volume_use_ssl           = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] osapi_volume_workers           = 2 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] per_volume_size_limit          = -1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] periodic_fuzzy_delay           = 60 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] periodic_interval              = 60 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] public_endpoint                = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] publish_errors                 = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] quota_backup_gigabytes         = 1000 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] quota_backups                  = 10 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] quota_gigabytes                = 1000 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] quota_groups                   = 10 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] quota_snapshots                = 10 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] quota_volumes                  = 10 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] rate_limit_burst               = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] rate_limit_except_level        = CRITICAL {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] rate_limit_interval            = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] reinit_driver_count            = 3 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] replication_device             = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] report_discard_supported       = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] report_interval                = 120 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] reservation_clean_interval     = 86400 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] reservation_expire             = 86400 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] reserved_image_namespaces      = [] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] reserved_percentage            = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] rpc_response_timeout           = 120 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] run_external_periodic_tasks    = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] scst_target_driver             = iscsi {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] scst_target_iqn_name           = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] service_down_time              = 720 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] shell_completion               = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] snapshot_name_template         = snapshot-%s {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] snapshot_same_host             = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] split_loggers                  = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] state_path                     = /opt/stack/data/cinder {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] storage_availability_zone      = nova {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] storage_protocol               = iSCSI {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] syslog_log_facility            = LOG_USER {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] target_helper                  = lioadm {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] target_ip_address              = 192.168.122.48 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] target_port                    = 3260 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] target_protocol                = iscsi {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] target_secondary_ip_addresses  = [] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] trace_flags                    = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] transport_url                  = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] until_refresh                  = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] use_chap_auth                  = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] use_default_quota_class        = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] use_journal                    = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] use_json                       = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] use_multipath_for_image_xfer   = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] use_stderr                     = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] use_syslog                     = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] verify_glance_signatures       = enabled {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.054s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] volume_api_class               = cinder.volume.api.API {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] volume_backend_name            = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] volume_clear                   = zero {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] volume_clear_ionice            = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] volume_clear_size              = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] volume_copy_bps_limit          = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] volume_dd_blocksize            = 1M {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] volume_name_template           = volume-%s {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] volume_service_inithost_offload = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] volume_usage_audit_period      = month {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] zoning_mode                    = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_concurrency.disable_process_locking = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.admin_password = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.admin_token = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.admin_user  = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.auth_protocol = https {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.auth_section = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.auth_type   = password {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.auth_uri    = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.auth_version = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.cache       = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.certfile    = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.identity_uri = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.include_service_catalog = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.insecure    = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.interface   = public {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.keyfile     = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_password =  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcache_username =  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.region_name = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.service_type = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.48/identity {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.backend                  = dogpile.cache.null {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.backend_argument         = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.backend_expiration_time  = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.config_prefix            = cache.oslo {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.debug_cache_backend      = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.enable_retry_client      = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.enable_socket_keepalive  = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.enabled                  = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.enforce_fips_mode        = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.expiration_time          = 600 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.hashclient_retry_attempts = 2 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.memcache_dead_retry      = 300 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.memcache_sasl_enabled    = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.password                 = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.proxies                  = [] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.redis_db                 = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.redis_server             = localhost:6379 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.retry_attempts           = 2 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.retry_delay              = 0.0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.socket_keepalive_count   = 1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.socket_keepalive_idle    = 1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.socket_keepalive_interval = 1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.socket_timeout           = 1.0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.tls_allowed_ciphers      = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.tls_cafile               = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.tls_certfile             = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.tls_enabled              = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.tls_keyfile              = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cache.username                 = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] coordination.backend_url       = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.asyncio_connection    = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.asyncio_slave_connection = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.backend               = sqlalchemy {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.connection            = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.connection_debug      = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.connection_parameters =  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.connection_recycle_time = 3600 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.connection_trace      = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.db_inc_retry_interval = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.db_max_retries        = 20 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.db_max_retry_interval = 10 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.db_retry_interval     = 1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.max_overflow          = 50 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.max_pool_size         = 5 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.max_retries           = 10 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.mysql_wsrep_sync_wait = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.pool_timeout          = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.retry_interval        = 10 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.slave_connection      = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.sqlite_synchronous    = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.synchronous_reader    = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] database.use_db_reconnect      = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] profiler.connection_string     = messaging:// {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] profiler.enabled               = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] profiler.es_doc_type           = notification {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] profiler.es_scroll_size        = 10000 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] profiler.es_scroll_time        = 2m {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] profiler.filter_error_trace    = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] profiler.hmac_keys             = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] profiler.sentinel_service_name = mymaster {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] profiler.socket_timeout        = 0.1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] profiler.trace_requests        = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] profiler.trace_sqlalchemy      = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] profiler_jaeger.process_tags   = {} {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] profiler_jaeger.service_name_prefix = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] profiler_otlp.service_name_prefix = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_policy.enforce_new_defaults = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: WARNING oslo_config.cfg [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_policy.enforce_scope      = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_policy.policy_default_rule = default {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] privsep_osbrick.group          = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] privsep_osbrick.helper_command = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] privsep_osbrick.user           = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cinder_sys_admin.group         = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cinder_sys_admin.helper_command = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack sudo[72270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] cinder_sys_admin.user          = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack sudo[72270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] service_user.auth_section      = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] service_user.auth_type         = password {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] service_user.cafile            = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] service_user.certfile          = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] service_user.collect_timing    = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] service_user.insecure          = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] service_user.keyfile           = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] service_user.send_service_user_token = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] service_user.split_loggers     = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] service_user.timeout           = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance.auth_section            = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance.auth_type               = password {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance.certfile                = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance.collect_timing          = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance.insecure                = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance.keyfile                 = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance.region_name             = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance.split_loggers           = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] glance.timeout                 = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.backend_availability_zone = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.chap_password = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.chap_username =  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.disk_geometry = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.driver_client_cert = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.driver_client_cert_key = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.driver_data_namespace = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.driver_use_ssl = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.extra_capabilities = {} {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.filter_function = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.goodness_function = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.iscsi_target_flags =  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.iscsi_write_cache = on {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.iser_ip_address = 192.168.122.48 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.iser_port     = 3260 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.lvm_share_target = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.lvm_type      = auto {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.num_shell_tries = 3 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.replication_device = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.report_discard_supported = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.reserved_percentage = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.target_helper = tgtadm {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.target_ip_address = 192.168.122.48 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.target_port   = 3260 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.target_protocol = iscsi {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.trace_flags   = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.unique_fqdn_network = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.use_chap_auth = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.volume_backend_name = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.volume_clear  = zero {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.volume_clear_ionice = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.volume_clear_size = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_reports.file_event_handler = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_reports.log_dir           = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.backend_host       = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.chap_password      = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.chap_username      = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.disk_geometry      = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.driver_client_cert = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.extra_capabilities = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.filter_function    = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.goodness_function  = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.iser_helper        = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.iser_port          = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.lvm_type           = auto {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.replication_device = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.report_discard_supported = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.reserved_percentage = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.scst_target_driver = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.storage_protocol   = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.target_ip_address  = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.target_port        = 3260 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.trace_flags        = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.volume_clear       = zero {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] lvmdriver-1.volumes_dir        = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_notifications.driver = [] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_notifications.retry = -1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] key_manager.fixed_key          = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.barbican_api_version  = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.barbican_endpoint     = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.barbican_endpoint_type = public {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.barbican_region_name  = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.cafile                = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.certfile              = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.collect_timing        = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.insecure              = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.keyfile               = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.number_of_retries     = 60 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.retry_delay           = 1 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.send_service_user_token = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.split_loggers         = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.timeout               = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.verify_ssl            = True {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican.verify_ssl_path       = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican_service_user.auth_section = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican_service_user.auth_type = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican_service_user.cafile   = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican_service_user.certfile = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican_service_user.collect_timing = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican_service_user.insecure = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican_service_user.keyfile  = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican_service_user.split_loggers = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] barbican_service_user.timeout  = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] vault.approle_role_id          = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] vault.approle_secret_id        = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] vault.kv_mountpoint            = secret {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] vault.kv_path                  = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] vault.kv_version               = 2 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] vault.namespace                = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] vault.root_token_id            = **** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] vault.ssl_ca_crt_file          = None {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] vault.timeout                  = 60.0 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] vault.use_ssl                  = False {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:14:08 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] ******************************************************************************** {{(pid=72164) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 14 01:14:09 devstack sudo[72270]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:09 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.539s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:09 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:09 devstack sudo[72319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 14 01:14:09 devstack sudo[72319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:09 devstack sudo[72319]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:09 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.508s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:09 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:14:09 devstack cinder-volume[72266]: INFO cinder.brick.local_dev.lvm [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 14 01:14:09 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:09 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:09 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:09 devstack sudo[72555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 14 01:14:09 devstack sudo[72555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:10 devstack sudo[72555]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:10 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.575s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:10 devstack cinder-volume[72266]: DEBUG cinder.brick.local_dev.lvm [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72266) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 14 01:14:10 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:10 devstack sudo[72767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 14 01:14:10 devstack sudo[72767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:11 devstack sudo[72767]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:11 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.169s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:11 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:11 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:11 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:11 devstack sudo[72961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 14 01:14:11 devstack sudo[72961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:12 devstack sudo[72961]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:12 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.481s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:12 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:12 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:12 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:12 devstack sudo[72993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 14 01:14:12 devstack sudo[72993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:12 devstack sudo[72993]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:12 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.459s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:12 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:12 devstack sudo[72996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 14 01:14:12 devstack sudo[72996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:12 devstack sudo[72996]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:12 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:12 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:13 devstack sudo[73002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 14 01:14:13 devstack sudo[73002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:13 devstack sudo[73002]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:13 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.481s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:13 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:13 devstack sudo[73008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 14 01:14:13 devstack sudo[73008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:13 devstack sudo[73008]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:13 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:13 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:13 devstack sudo[73013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 14 01:14:13 devstack sudo[73013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:14 devstack sudo[73013]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:14 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:14 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:14 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:14 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:14 devstack sudo[73017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 14 01:14:14 devstack sudo[73017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:14 devstack sudo[73017]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:14 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.533s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:14 devstack cinder-volume[72266]: INFO cinder.volume.drivers.lvm [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 14 01:14:14 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:14 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:14 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:14 devstack sudo[73137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 14 01:14:14 devstack sudo[73137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:15 devstack sudo[73137]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:15 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.482s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:15 devstack cinder-volume[72266]: DEBUG cinder.volume.drivers.lvm [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Updating volume stats {{(pid=72266) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 14 01:14:15 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:15 devstack sudo[73140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 14 01:14:15 devstack sudo[73140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:15 devstack sudo[73140]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:15 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:15 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:15 devstack sudo[73281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 14 01:14:15 devstack sudo[73281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:16 devstack sudo[73281]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:16 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:16 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:16 devstack sudo[73284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 14 01:14:16 devstack sudo[73284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:16 devstack sudo[73284]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:16 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:16 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:16 devstack sudo[73287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 14 01:14:16 devstack sudo[73287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:17 devstack sudo[73287]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:17 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:17 devstack cinder-volume[72266]: INFO cinder.volume.driver [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Driver hasn't implemented _init_vendor_properties()
Apr 14 01:14:17 devstack cinder-volume[72266]: DEBUG cinder.volume.driver [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72266) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 14 01:14:17 devstack cinder-volume[72266]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72266) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 14 01:14:17 devstack cinder-volume[72266]: DEBUG dbcounter [-] [72266] Writer thread running {{(pid=72266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 14 01:14:17 devstack cinder-volume[72266]: DEBUG cinder.db.sqlalchemy.api [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Building query based on filter {{(pid=72266) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 14 01:14:17 devstack cinder-volume[72266]: DEBUG cinder.image.image_utils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72266) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 14 01:14:17 devstack cinder-volume[72266]: INFO cinder.keymgr.migration [None req-49de6c13-7501-4f17-9d25-8804bbbb9b34 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 14 01:14:17 devstack cinder-volume[72266]: DEBUG cinder.volume.drivers.lvm [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Updating volume stats {{(pid=72266) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 14 01:14:17 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:17 devstack sudo[73294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 14 01:14:17 devstack sudo[73294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:17 devstack sudo[73294]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:17 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:17 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:17 devstack sudo[73300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 14 01:14:17 devstack sudo[73300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:18 devstack sudo[73300]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:18 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:18 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:18 devstack sudo[73305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 14 01:14:18 devstack sudo[73305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:18 devstack cinder-volume[72164]: DEBUG dbcounter [-] [72164] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72164) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:14:18 devstack sudo[73305]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:18 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.476s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:18 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:18 devstack sudo[73309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 14 01:14:18 devstack sudo[73309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:19 devstack sudo[73309]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:19 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:19 devstack cinder-volume[72266]: DEBUG cinder.manager [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Notifying Schedulers of capabilities ... {{(pid=72266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:14:19 devstack cinder-volume[72266]: INFO cinder.volume.manager [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Driver initialization completed successfully.
Apr 14 01:14:19 devstack cinder-volume[72266]: INFO cinder.manager [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Initiating service 2 cleanup
Apr 14 01:14:19 devstack cinder-volume[72266]: INFO cinder.manager [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Service 2 cleanup completed.
Apr 14 01:14:19 devstack cinder-volume[72266]: DEBUG cinder.service [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Creating RPC server for service cinder-volume {{(pid=72266) start /opt/stack/cinder/cinder/service.py:231}}
Apr 14 01:14:19 devstack cinder-volume[72266]: DEBUG cinder.service [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72266) start /opt/stack/cinder/cinder/service.py:237}}
Apr 14 01:14:19 devstack cinder-volume[72266]: INFO cinder.volume.manager [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 14 01:14:19 devstack cinder-volume[72266]: DEBUG cinder.volume.drivers.lvm [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Updating volume stats {{(pid=72266) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 14 01:14:19 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:19 devstack sudo[73314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 14 01:14:19 devstack sudo[73314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:19 devstack sudo[73314]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:19 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:19 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:19 devstack sudo[73327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 14 01:14:19 devstack sudo[73327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:20 devstack sudo[73327]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:20 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:20 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:20 devstack sudo[73377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 14 01:14:20 devstack sudo[73377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:20 devstack sudo[73377]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:20 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:20 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:14:20 devstack sudo[73380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 14 01:14:20 devstack sudo[73380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:14:21 devstack sudo[73380]: pam_unix(sudo:session): session closed for user root
Apr 14 01:14:21 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:14:21 devstack cinder-volume[72266]: INFO cinder.volume.manager [None req-7cf812d2-732a-4ffb-85af-e616c04b443f None None] Driver post RPC initialization completed successfully.
Apr 14 01:14:31 devstack cinder-volume[72266]: DEBUG dbcounter [-] [72266] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:14:31 devstack cinder-volume[72266]: DEBUG dbcounter [-] [72266] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=72266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:15:21 devstack cinder-volume[72266]: DEBUG oslo_service.periodic_task [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:15:21 devstack cinder-volume[72266]: DEBUG cinder.volume.drivers.lvm [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Updating volume stats {{(pid=72266) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 14 01:15:21 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:15:21 devstack sudo[78109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 14 01:15:21 devstack sudo[78109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:15:21 devstack sudo[78109]: pam_unix(sudo:session): session closed for user root
Apr 14 01:15:21 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.416s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:15:21 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:15:21 devstack sudo[78112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 14 01:15:21 devstack sudo[78112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:15:21 devstack sudo[78112]: pam_unix(sudo:session): session closed for user root
Apr 14 01:15:21 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:15:21 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:15:21 devstack sudo[78115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 14 01:15:21 devstack sudo[78115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:15:22 devstack sudo[78115]: pam_unix(sudo:session): session closed for user root
Apr 14 01:15:22 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:15:22 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:15:22 devstack sudo[78118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 14 01:15:22 devstack sudo[78118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:15:22 devstack sudo[78118]: pam_unix(sudo:session): session closed for user root
Apr 14 01:15:22 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:15:22 devstack cinder-volume[72266]: DEBUG cinder.manager [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Notifying Schedulers of capabilities ... {{(pid=72266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:16:21 devstack cinder-volume[72266]: DEBUG oslo_service.periodic_task [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:16:21 devstack cinder-volume[72266]: DEBUG cinder.volume.drivers.lvm [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Updating volume stats {{(pid=72266) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 14 01:16:21 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:16:21 devstack sudo[79289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 14 01:16:21 devstack sudo[79289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:16:21 devstack sudo[79289]: pam_unix(sudo:session): session closed for user root
Apr 14 01:16:21 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:16:21 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:16:21 devstack sudo[79321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 14 01:16:21 devstack sudo[79321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:16:22 devstack sudo[79321]: pam_unix(sudo:session): session closed for user root
Apr 14 01:16:22 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:16:22 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:16:22 devstack sudo[79360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 14 01:16:22 devstack sudo[79360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:16:22 devstack sudo[79360]: pam_unix(sudo:session): session closed for user root
Apr 14 01:16:22 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.444s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:16:22 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:16:22 devstack sudo[79389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 14 01:16:22 devstack sudo[79389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:16:22 devstack sudo[79389]: pam_unix(sudo:session): session closed for user root
Apr 14 01:16:22 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:16:22 devstack cinder-volume[72266]: DEBUG cinder.manager [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Notifying Schedulers of capabilities ... {{(pid=72266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:16:31 devstack cinder-volume[72266]: DEBUG dbcounter [-] [72266] Writing DB stats cinder:SELECT=1 {{(pid=72266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:16:31 devstack cinder-volume[72266]: DEBUG dbcounter [-] [72266] Writing DB stats cinder:UPDATE=1 {{(pid=72266) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:17:21 devstack cinder-volume[72266]: DEBUG oslo_service.periodic_task [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:17:21 devstack cinder-volume[72266]: DEBUG cinder.volume.drivers.lvm [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Updating volume stats {{(pid=72266) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 14 01:17:21 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:17:21 devstack sudo[80961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 14 01:17:21 devstack sudo[80961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:17:21 devstack sudo[80961]: pam_unix(sudo:session): session closed for user root
Apr 14 01:17:21 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:17:21 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:17:21 devstack sudo[80964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 14 01:17:21 devstack sudo[80964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:17:21 devstack sudo[80964]: pam_unix(sudo:session): session closed for user root
Apr 14 01:17:21 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:17:21 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:17:21 devstack sudo[80990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 14 01:17:21 devstack sudo[80990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:17:22 devstack sudo[80990]: pam_unix(sudo:session): session closed for user root
Apr 14 01:17:22 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.429s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:17:22 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:17:22 devstack sudo[80996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 14 01:17:22 devstack sudo[80996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:17:22 devstack sudo[80996]: pam_unix(sudo:session): session closed for user root
Apr 14 01:17:22 devstack cinder-volume[72266]: DEBUG oslo_concurrency.processutils [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:17:22 devstack cinder-volume[72266]: DEBUG cinder.manager [None req-7eaafc8d-66e4-451c-928b-feb121739d18 None None] Notifying Schedulers of capabilities ... {{(pid=72266) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:17:32 devstack cinder-volume[72164]: INFO oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Caught SIGTERM, stopping children
Apr 14 01:17:32 devstack cinder-volume[72164]: DEBUG oslo_concurrency.lockutils [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Acquiring lock "singleton_lock" {{(pid=72164) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 14 01:17:32 devstack cinder-volume[72164]: DEBUG oslo_concurrency.lockutils [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Acquired lock "singleton_lock" {{(pid=72164) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 14 01:17:32 devstack cinder-volume[72164]: DEBUG oslo_concurrency.lockutils [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Releasing lock "singleton_lock" {{(pid=72164) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 14 01:17:32 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Stop services. {{(pid=72164) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 14 01:17:32 devstack cinder-volume[72164]: DEBUG oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Killing children. {{(pid=72164) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 14 01:17:32 devstack cinder-volume[72164]: INFO oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Waiting on 1 children to exit
Apr 14 01:17:34 devstack cinder-volume[72266]: DEBUG oslo_concurrency.lockutils [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Acquiring lock "singleton_lock" {{(pid=72266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 14 01:17:34 devstack cinder-volume[72266]: DEBUG oslo_concurrency.lockutils [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Acquired lock "singleton_lock" {{(pid=72266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 14 01:17:34 devstack cinder-volume[72266]: DEBUG oslo_concurrency.lockutils [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Releasing lock "singleton_lock" {{(pid=72266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 14 01:17:34 devstack cinder-volume[72266]: WARNING amqp [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 14 01:17:34 devstack cinder-volume[72266]: WARNING amqp [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 14 01:17:34 devstack cinder-volume[72164]: INFO oslo_service.backend._eventlet.service [None req-0005bbd5-564c-448c-a7d7-f78c80df4b46 None None] Child 72266 exited with status 0
Apr 14 01:17:34 devstack cinder-volume[81338]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 14 01:17:34 devstack cinder-volume[81338]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 14 01:17:34 devstack cinder-volume[81338]: we strongly recommend against using it for new projects.
Apr 14 01:17:34 devstack cinder-volume[81338]: If you are already using Eventlet, we recommend migrating to a different
Apr 14 01:17:34 devstack cinder-volume[81338]: framework.  For more detail see
Apr 14 01:17:34 devstack cinder-volume[81338]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 14 01:17:34 devstack cinder-volume[81338]:   import eventlet  # noqa
Apr 14 01:17:36 devstack cinder-volume[81338]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81338) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 14 01:17:36 devstack cinder-volume[81338]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81338) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 14 01:17:36 devstack cinder-volume[81338]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81338) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 14 01:17:36 devstack cinder-volume[81338]: INFO dbcounter [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Registered counter for database cinder
Apr 14 01:17:36 devstack cinder-volume[81338]: DEBUG oslo_db.sqlalchemy.engines [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81338) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG dbcounter [-] [81338] Writer thread running {{(pid=81338) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 14 01:17:37 devstack cinder-volume[81338]: INFO cinder.rpc [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 14 01:17:37 devstack cinder-volume[81338]: INFO cinder.rpc [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_db.sqlalchemy.engines [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81338) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 14 01:17:37 devstack cinder-volume[81338]: INFO cinder.volume.manager [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Determined volume DB was empty at startup.
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG cinder.volume.manager [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81338) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 14 01:17:37 devstack cinder-volume[81338]: INFO cinder.volume.manager [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 14 01:17:37 devstack cinder-volume[81338]: WARNING stevedore.named [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 14 01:17:37 devstack cinder-volume[81338]: WARNING castellan.key_manager [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 14 01:17:37 devstack cinder-volume[81338]: WARNING cinder.keymgr.conf_key_mgr [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 14 01:17:37 devstack cinder-volume[81338]: INFO cinder.volume.manager [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_db.sqlalchemy.engines [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81338) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 14 01:17:37 devstack cinder-volume[81338]: INFO oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Starting 1 workers
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Started child 81454 {{(pid=81338) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Full set of CONF: {{(pid=81338) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] ******************************************************************************** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Configuration options gathered from: {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] ================================================================================ {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] allow_availability_zone_fallback = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] allow_compression_on_image_upload = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] allowed_direct_url_schemes     = [] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] api_rate_limit                 = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] auth_strategy                  = keystone {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_availability_zone      = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_host                   = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_name                   = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_stats_polling_interval = 60 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backup_api_class               = cinder.backup.api.API {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backup_name_template           = backup-%s {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backup_use_same_host           = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backup_use_temp_snapshot       = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] chap_password                  = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] chap_username                  =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cinder_internal_tenant_project_id = 029a4b65e91b4bafb453b33dfeff2d5f {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cinder_internal_tenant_user_id = c144d19d9ee849d2899eda36a0c301b7 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cluster                        = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] compression_format             = gzip {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] compute_api_class              = cinder.compute.nova.API {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] config_dir                     = [] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] config_source                  = [] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] control_exchange               = openstack {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] debug                          = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] default_availability_zone      = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] default_group_type             = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] default_volume_type            = QuobyteHD {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] disk_geometry                  = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] driver_client_cert             = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] driver_client_cert_key         = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] driver_data_namespace          = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] driver_ssl_cert_path           = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] driver_ssl_cert_verify         = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] driver_use_ssl                 = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] enable_new_services            = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] enable_unsupported_driver      = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] enabled_backends               = ['QuobyteHD'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] enforce_multipath_for_image_xfer = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] filter_function                = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance_api_insecure            = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance_api_servers             = ['http://192.168.122.48/image'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance_api_ssl_compression     = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance_ca_certificates_file    = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance_catalog_info            = image:glance:publicURL {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance_certfile                = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81454]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance_keyfile                 = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance_num_retries             = 3 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance_request_timeout         = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] goodness_function              = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] graceful_shutdown_timeout      = 5 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] group_api_class                = cinder.group.api.API {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] host                           = devstack {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] image_compress_on_upload       = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] image_conversion_address_space_limit = 1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] image_conversion_cpu_limit     = 60 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] image_conversion_disable       = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] image_upload_use_cinder_backend = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] image_upload_use_internal_tenant = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] image_volume_cache_enabled     = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] image_volume_cache_max_count   = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] image_volume_cache_max_size_gb = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] init_host_max_objects_retrieval = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] instance_format                = [instance: %(uuid)s]  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] iscsi_target_flags             =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] iscsi_write_cache              = on {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] iser_helper                    = tgtadm {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] iser_ip_address                = 192.168.122.48 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] iser_port                      = 3260 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] log_color                      = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] log_config_append              = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] log_dir                        = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] log_file                       = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] log_options                    = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] log_rotate_interval            = 1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] log_rotate_interval_type       = days {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] log_rotation_type              = none {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] max_age                        = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] max_logfile_count              = 30 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] max_logfile_size_mb            = 200 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] max_over_subscription_ratio    = 20.0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] message_reap_interval          = 86400 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] message_ttl                    = 2592000 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] migration_create_volume_timeout_secs = 300 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] monkey_patch                   = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] monkey_patch_modules           = [] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] my_ip                          = 192.168.122.48 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] no_snapshot_gb_quota           = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] num_iser_scan_tries            = 3 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] num_shell_tries                = 3 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] num_volume_device_scan_tries   = 3 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] nvmeof_conn_info_version       = 1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] nvmet_ns_id                    = 10 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] nvmet_port_id                  = 1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] osapi_max_limit                = 1000 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] osapi_volume_ext_list          = [] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] osapi_volume_listen_port       = 8776 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] osapi_volume_use_ssl           = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] osapi_volume_workers           = 2 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] per_volume_size_limit          = -1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] periodic_fuzzy_delay           = 60 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] periodic_interval              = 60 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81454]: INFO cinder.volume.manager [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 14 01:17:37 devstack cinder-volume[81454]: DEBUG cinder.volume.drivers.remotefs [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81454) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] public_endpoint                = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] publish_errors                 = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] quota_backup_gigabytes         = 1000 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] quota_backups                  = 10 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] quota_gigabytes                = 1000 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] quota_groups                   = 10 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] quota_snapshots                = 10 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] quota_volumes                  = 10 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] rate_limit_burst               = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] rate_limit_except_level        = CRITICAL {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] rate_limit_interval            = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] reinit_driver_count            = 3 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] replication_device             = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] report_discard_supported       = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] report_interval                = 120 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] reservation_clean_interval     = 86400 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] reservation_expire             = 86400 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] reserved_image_namespaces      = [] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] reserved_percentage            = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] rpc_response_timeout           = 120 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] run_external_periodic_tasks    = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] scst_target_driver             = iscsi {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] scst_target_iqn_name           = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] service_down_time              = 720 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] shell_completion               = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] snapshot_name_template         = snapshot-%s {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] split_loggers                  = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] state_path                     = /opt/stack/data/cinder {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] storage_availability_zone      = nova {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] storage_protocol               = iSCSI {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] syslog_log_facility            = LOG_USER {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] target_helper                  = lioadm {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] target_ip_address              = 192.168.122.48 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] target_port                    = 3260 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] target_protocol                = iscsi {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] target_secondary_ip_addresses  = [] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] trace_flags                    = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] transport_url                  = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] until_refresh                  = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] use_chap_auth                  = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] use_default_quota_class        = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] use_journal                    = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] use_json                       = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] use_multipath_for_image_xfer   = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] use_stderr                     = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] use_syslog                     = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] verify_glance_signatures       = enabled {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] volume_api_class               = cinder.volume.api.API {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] volume_backend_name            = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] volume_clear                   = zero {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] volume_clear_ionice            = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] volume_clear_size              = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] volume_copy_bps_limit          = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] volume_dd_blocksize            = 1M {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] volume_name_template           = volume-%s {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] volume_service_inithost_offload = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] volume_usage_audit_period      = month {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] zoning_mode                    = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_concurrency.disable_process_locking = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.admin_password = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.admin_token = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.admin_user  = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.auth_port   = 35357 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.auth_protocol = https {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.auth_section = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.auth_type   = password {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.auth_uri    = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.auth_version = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.cache       = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.certfile    = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.delay_auth_decision = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.http_connect_timeout = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81454]: DEBUG cinder.volume.drivers.quobyte [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81454) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 14 01:17:37 devstack cinder-volume[81454]: WARNING cinder.volume.drivers.quobyte [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 14 01:17:37 devstack cinder-volume[81454]: WARNING cinder.volume.drivers.quobyte [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 14 01:17:37 devstack cinder-volume[81454]: DEBUG oslo_concurrency.processutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Running cmd (subprocess): mount.quobyte {{(pid=81454) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.identity_uri = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.include_service_catalog = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.insecure    = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.interface   = public {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.keyfile     = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_password =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcache_username =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.region_name = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.service_token_roles_required = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.service_type = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.token_cache_time = 300 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.48/identity {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.backend                  = dogpile.cache.null {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.backend_argument         = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.backend_expiration_time  = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.config_prefix            = cache.oslo {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.debug_cache_backend      = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.enable_retry_client      = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.enable_socket_keepalive  = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.enabled                  = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.enforce_fips_mode        = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.expiration_time          = 600 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.hashclient_retry_attempts = 2 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.memcache_dead_retry      = 300 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.memcache_pool_maxsize    = 10 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.memcache_sasl_enabled    = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.password                 = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.proxies                  = [] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.redis_db                 = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.redis_sentinel_service_name = mymaster {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.redis_server             = localhost:6379 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.retry_attempts           = 2 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.retry_delay              = 0.0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.socket_keepalive_count   = 1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.socket_keepalive_idle    = 1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.socket_keepalive_interval = 1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.socket_timeout           = 1.0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.tls_allowed_ciphers      = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.tls_cafile               = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.tls_certfile             = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.tls_enabled              = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.tls_keyfile              = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cache.username                 = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] coordination.backend_url       = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.asyncio_connection    = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.asyncio_slave_connection = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.backend               = sqlalchemy {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.connection            = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.connection_debug      = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.connection_parameters =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.connection_recycle_time = 3600 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.connection_trace      = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.db_inc_retry_interval = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.db_max_retries        = 20 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.db_max_retry_interval = 10 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.db_retry_interval     = 1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.max_overflow          = 50 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.max_pool_size         = 5 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.max_retries           = 10 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.mysql_wsrep_sync_wait = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.pool_timeout          = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.retry_interval        = 10 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.slave_connection      = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.sqlite_synchronous    = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.synchronous_reader    = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] database.use_db_reconnect      = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] profiler.connection_string     = messaging:// {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] profiler.enabled               = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] profiler.es_doc_type           = notification {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] profiler.es_scroll_size        = 10000 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] profiler.es_scroll_time        = 2m {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] profiler.filter_error_trace    = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] profiler.hmac_keys             = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] profiler.sentinel_service_name = mymaster {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] profiler.socket_timeout        = 0.1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] profiler.trace_requests        = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] profiler.trace_sqlalchemy      = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] profiler_jaeger.process_tags   = {} {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] profiler_jaeger.service_name_prefix = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] profiler_otlp.service_name_prefix = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_policy.enforce_new_defaults = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: WARNING oslo_config.cfg [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_policy.enforce_scope      = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_policy.policy_default_rule = default {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_policy.policy_file        = policy.yaml {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] privsep_osbrick.group          = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] privsep_osbrick.helper_command = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] privsep_osbrick.user           = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cinder_sys_admin.group         = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cinder_sys_admin.helper_command = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] cinder_sys_admin.user          = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] service_user.auth_section      = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack quobyte-client[81455]: Reading configuration file: /etc/quobyte/client.cfg
Apr 14 01:17:37 devstack quobyte-client[81455]: Invalid parameters found, error: missing mount point.
Apr 14 01:17:37 devstack quobyte-client[81455]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 14 01:17:37 devstack quobyte-client[81455]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] service_user.auth_type         = password {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] service_user.cafile            = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] service_user.certfile          = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] service_user.collect_timing    = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] service_user.insecure          = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] service_user.keyfile           = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] service_user.send_service_user_token = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] service_user.split_loggers     = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] service_user.timeout           = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance.auth_section            = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance.auth_type               = password {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance.certfile                = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance.collect_timing          = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance.insecure                = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance.keyfile                 = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance.region_name             = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance.split_loggers           = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] glance.timeout                 = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.backend_availability_zone = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.chap_password = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.chap_username =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.disk_geometry = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.driver_client_cert = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.driver_client_cert_key = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.driver_data_namespace = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81454]: DEBUG oslo_concurrency.processutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] CMD "mount.quobyte" returned: 1 in 0.091s {{(pid=81454) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:17:37 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:17:37 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:17:37 devstack cinder-volume[81454]: DEBUG cinder.volume.drivers.quobyte [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81454) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:17:37 devstack cinder-volume[81454]: INFO cinder.volume.drivers.quobyte [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 ...
Apr 14 01:17:37 devstack cinder-volume[81454]: DEBUG oslo_concurrency.processutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf -c /etc/quobyte/client-cinder.cfg {{(pid=81454) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.driver_use_ssl = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.enable_unsupported_driver = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.extra_capabilities = {} {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.filter_function = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.goodness_function = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.iscsi_target_flags =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.iscsi_write_cache = on {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.iser_helper   = tgtadm {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.iser_ip_address = 192.168.122.48 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.iser_port     = 3260 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.nas_host      =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.nas_login     = admin {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.nas_mount_options = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.nas_password  = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.nas_private_key =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.nas_share_path =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.num_shell_tries = 3 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.nvmet_port_id = 1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.quobyte_client_cfg = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.quobyte_volume_url = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.replication_device = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.report_discard_supported = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.reserved_percentage = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.scst_target_driver = iscsi {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.scst_target_iqn_name = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.storage_protocol = iSCSI {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.target_helper = tgtadm {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.target_ip_address = 192.168.122.48 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.target_port   = 3260 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.target_protocol = iscsi {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.trace_flags   = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.unique_fqdn_network = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.use_chap_auth = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.volume_backend_name = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.volume_clear  = zero {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.volume_clear_ionice = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.volume_clear_size = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_reports.file_event_handler = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_reports.log_dir           = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.backend_availability_zone = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.backend_host         = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.chap_password        = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.chap_username        = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.chiscsi_conf         = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.disk_geometry        = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.driver_client_cert   = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.driver_client_cert_key = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.driver_data_namespace = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.driver_use_ssl       = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.extra_capabilities   = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.filter_function      = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.goodness_function    = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.iser_helper          = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.iser_ip_address      = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.iser_port            = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.iser_target_prefix   = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.nas_host             = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.nas_login            = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.nas_mount_options    = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.nas_password         = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.nas_private_key      = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.nas_share_path       = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.nas_ssh_port         = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.num_shell_tries      = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.nvmet_port_id        = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.replication_device   = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.report_discard_supported = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.reserved_percentage  = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.scst_target_driver   = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.storage_protocol     = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.target_helper        = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.target_ip_address    = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.target_port          = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.target_prefix        = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.target_protocol      = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.trace_flags          = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.use_chap_auth        = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.volume_clear         = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.volume_clear_size    = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] QuobyteHD.volumes_dir          = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack sudo[81459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf -c /etc/quobyte/client-cinder.cfg
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack sudo[81459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.ssl      = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_notifications.driver = [] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_notifications.retry = -1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] oslo_messaging_notifications.transport_url = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] key_manager.fixed_key          = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.barbican_api_version  = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.barbican_endpoint     = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.barbican_endpoint_type = public {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.barbican_region_name  = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.cafile                = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.certfile              = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.collect_timing        = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.insecure              = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.keyfile               = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.number_of_retries     = 60 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.retry_delay           = 1 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.send_service_user_token = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.split_loggers         = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.timeout               = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.verify_ssl            = True {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican.verify_ssl_path       = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican_service_user.auth_section = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican_service_user.auth_type = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican_service_user.cafile   = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican_service_user.certfile = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican_service_user.collect_timing = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican_service_user.insecure = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican_service_user.keyfile  = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican_service_user.split_loggers = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] barbican_service_user.timeout  = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] vault.approle_role_id          = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] vault.approle_secret_id        = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] vault.kv_mountpoint            = secret {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] vault.kv_path                  = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] vault.kv_version               = 2 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] vault.namespace                = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] vault.root_token_id            = **** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] vault.ssl_ca_crt_file          = None {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] vault.timeout                  = 60.0 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] vault.use_ssl                  = False {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:37 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] ******************************************************************************** {{(pid=81338) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 14 01:17:38 devstack sudo[81459]: pam_unix(sudo:session): session closed for user root
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG oslo_concurrency.processutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.561s {{(pid=81454) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:17:38 devstack cinder-volume[81454]: INFO cinder.volume.drivers.quobyte [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 succeeded
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG cinder.volume.drivers.quobyte [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81454) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.568s {{(pid=81454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG oslo_concurrency.processutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81454) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:17:38 devstack sudo[81528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:17:38 devstack sudo[81528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:17:38 devstack sudo[81528]: pam_unix(sudo:session): session closed for user root
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG oslo_concurrency.processutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.427s {{(pid=81454) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:17:38 devstack cinder-volume[81454]: INFO cinder.volume.driver [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Driver hasn't implemented _init_vendor_properties()
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG cinder.volume.driver [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7474403381348, 'free_capacity_gb': 1775.7474403381348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81454) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG oslo_db.sqlalchemy.engines [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81454) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG dbcounter [-] [81454] Writer thread running {{(pid=81454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG cinder.db.sqlalchemy.api [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Building query based on filter {{(pid=81454) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG cinder.image.image_utils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81454) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 14 01:17:38 devstack cinder-volume[81454]: INFO cinder.keymgr.migration [None req-2f85549d-1d3d-4631-aeb2-24f6eadb0e13 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG cinder.volume.drivers.quobyte [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81454) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG cinder.volume.drivers.quobyte [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81454) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG oslo_concurrency.processutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81454) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:17:38 devstack sudo[81531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:17:38 devstack sudo[81531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:17:38 devstack sudo[81531]: pam_unix(sudo:session): session closed for user root
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG oslo_concurrency.processutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.388s {{(pid=81454) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG cinder.manager [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Notifying Schedulers of capabilities ... {{(pid=81454) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:17:38 devstack cinder-volume[81454]: INFO cinder.volume.manager [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Driver initialization completed successfully.
Apr 14 01:17:38 devstack cinder-volume[81454]: INFO cinder.manager [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Initiating service 3 cleanup
Apr 14 01:17:38 devstack cinder-volume[81454]: INFO cinder.manager [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Service 3 cleanup completed.
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG cinder.service [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Creating RPC server for service cinder-volume {{(pid=81454) start /opt/stack/cinder/cinder/service.py:231}}
Apr 14 01:17:38 devstack cinder-volume[81454]: DEBUG cinder.service [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81454) start /opt/stack/cinder/cinder/service.py:237}}
Apr 14 01:17:39 devstack cinder-volume[81454]: INFO cinder.volume.manager [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 14 01:17:39 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:17:39 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:17:39 devstack cinder-volume[81454]: DEBUG cinder.volume.drivers.quobyte [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81454) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:17:39 devstack cinder-volume[81454]: DEBUG cinder.volume.drivers.quobyte [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81454) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:17:39 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:17:39 devstack cinder-volume[81454]: DEBUG oslo_concurrency.processutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81454) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:17:39 devstack sudo[81536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:17:39 devstack sudo[81536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:17:39 devstack sudo[81536]: pam_unix(sudo:session): session closed for user root
Apr 14 01:17:39 devstack cinder-volume[81454]: DEBUG oslo_concurrency.processutils [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.411s {{(pid=81454) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:17:39 devstack cinder-volume[81454]: INFO cinder.volume.manager [None req-f03edc61-1c0c-45b6-8a75-188ac214dd1c None None] Driver post RPC initialization completed successfully.
Apr 14 01:17:42 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-affb343d-4599-4e51-afb3-e88602eed693 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:17:42 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-affb343d-4599-4e51-afb3-e88602eed693 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:17:42 devstack cinder-volume[81454]: DEBUG cinder.volume.drivers.quobyte [None req-affb343d-4599-4e51-afb3-e88602eed693 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81454) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:17:42 devstack cinder-volume[81454]: DEBUG cinder.volume.drivers.quobyte [None req-affb343d-4599-4e51-afb3-e88602eed693 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81454) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:17:42 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-affb343d-4599-4e51-afb3-e88602eed693 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:17:42 devstack cinder-volume[81454]: DEBUG oslo_concurrency.processutils [None req-affb343d-4599-4e51-afb3-e88602eed693 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81454) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:17:42 devstack sudo[81601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:17:42 devstack sudo[81601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:17:42 devstack sudo[81601]: pam_unix(sudo:session): session closed for user root
Apr 14 01:17:42 devstack cinder-volume[81454]: DEBUG oslo_concurrency.processutils [None req-affb343d-4599-4e51-afb3-e88602eed693 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.368s {{(pid=81454) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:17:42 devstack cinder-volume[81454]: DEBUG cinder.manager [None req-affb343d-4599-4e51-afb3-e88602eed693 None None] Notifying Schedulers of capabilities ... {{(pid=81454) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:17:46 devstack cinder-volume[81338]: INFO oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Caught SIGTERM, stopping children
Apr 14 01:17:46 devstack cinder-volume[81338]: DEBUG oslo_concurrency.lockutils [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Acquiring lock "singleton_lock" {{(pid=81338) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 14 01:17:46 devstack cinder-volume[81338]: DEBUG oslo_concurrency.lockutils [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Acquired lock "singleton_lock" {{(pid=81338) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 14 01:17:46 devstack cinder-volume[81338]: DEBUG oslo_concurrency.lockutils [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Releasing lock "singleton_lock" {{(pid=81338) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 14 01:17:46 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Stop services. {{(pid=81338) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 14 01:17:46 devstack cinder-volume[81338]: DEBUG oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Killing children. {{(pid=81338) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 14 01:17:46 devstack cinder-volume[81338]: INFO oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Waiting on 1 children to exit
Apr 14 01:17:47 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Acquiring lock "singleton_lock" {{(pid=81454) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 14 01:17:47 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Acquired lock "singleton_lock" {{(pid=81454) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 14 01:17:47 devstack cinder-volume[81454]: DEBUG oslo_concurrency.lockutils [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Releasing lock "singleton_lock" {{(pid=81454) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 14 01:17:47 devstack cinder-volume[81454]: WARNING amqp [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 14 01:17:47 devstack cinder-volume[81454]: WARNING amqp [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 14 01:17:47 devstack cinder-volume[81338]: INFO oslo_service.backend._eventlet.service [None req-07c2ec42-f48e-4293-9c72-f7c0ffc3107c None None] Child 81454 exited with status 0
Apr 14 01:17:47 devstack cinder-volume[81673]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 14 01:17:47 devstack cinder-volume[81673]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 14 01:17:47 devstack cinder-volume[81673]: we strongly recommend against using it for new projects.
Apr 14 01:17:47 devstack cinder-volume[81673]: If you are already using Eventlet, we recommend migrating to a different
Apr 14 01:17:47 devstack cinder-volume[81673]: framework.  For more detail see
Apr 14 01:17:47 devstack cinder-volume[81673]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 14 01:17:47 devstack cinder-volume[81673]:   import eventlet  # noqa
Apr 14 01:17:49 devstack cinder-volume[81673]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81673) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 14 01:17:49 devstack cinder-volume[81673]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81673) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 14 01:17:49 devstack cinder-volume[81673]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81673) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 14 01:17:49 devstack cinder-volume[81673]: INFO dbcounter [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] Registered counter for database cinder
Apr 14 01:17:49 devstack cinder-volume[81673]: DEBUG oslo_db.sqlalchemy.engines [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81673) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 14 01:17:49 devstack cinder-volume[81673]: DEBUG dbcounter [-] [81673] Writer thread running {{(pid=81673) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 14 01:17:49 devstack cinder-volume[81673]: INFO cinder.rpc [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 14 01:17:49 devstack cinder-volume[81673]: INFO cinder.rpc [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 14 01:17:49 devstack cinder-volume[81673]: DEBUG oslo_db.sqlalchemy.engines [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81673) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 14 01:17:50 devstack cinder-volume[81673]: INFO cinder.volume.manager [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] Determined volume DB was empty at startup.
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG cinder.volume.manager [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81673) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 14 01:17:50 devstack cinder-volume[81673]: WARNING stevedore.named [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 14 01:17:50 devstack cinder-volume[81673]: WARNING castellan.key_manager [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 14 01:17:50 devstack cinder-volume[81673]: WARNING cinder.keymgr.conf_key_mgr [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 14 01:17:50 devstack cinder-volume[81673]: INFO cinder.volume.manager [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_db.sqlalchemy.engines [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81673) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 14 01:17:50 devstack cinder-volume[81673]: INFO oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] Starting 1 workers
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] Started child 81812 {{(pid=81673) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] Full set of CONF: {{(pid=81673) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] ******************************************************************************** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] Configuration options gathered from: {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] ================================================================================ {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] allow_availability_zone_fallback = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] allow_compression_on_image_upload = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] allowed_direct_url_schemes     = [] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] api_rate_limit                 = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] auth_strategy                  = keystone {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_availability_zone      = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_host                   = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_name                   = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_stats_polling_interval = 60 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backup_api_class               = cinder.backup.api.API {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backup_name_template           = backup-%s {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backup_use_same_host           = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backup_use_temp_snapshot       = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] chap_password                  = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] chap_username                  =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cinder_internal_tenant_project_id = 029a4b65e91b4bafb453b33dfeff2d5f {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cinder_internal_tenant_user_id = c144d19d9ee849d2899eda36a0c301b7 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cluster                        = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] compression_format             = gzip {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] compute_api_class              = cinder.compute.nova.API {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] config_dir                     = [] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] config_source                  = [] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] control_exchange               = openstack {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] debug                          = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] default_availability_zone      = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] default_group_type             = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] default_volume_type            = QuobyteHD {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] disk_geometry                  = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] driver_client_cert             = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] driver_client_cert_key         = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] driver_data_namespace          = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] driver_ssl_cert_path           = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] driver_ssl_cert_verify         = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] driver_use_ssl                 = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] enable_new_services            = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] enable_unsupported_driver      = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] enabled_backends               = ['QuobyteHD'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] enforce_multipath_for_image_xfer = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] filter_function                = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance_api_insecure            = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance_api_servers             = ['http://192.168.122.48/image'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance_api_ssl_compression     = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance_ca_certificates_file    = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance_catalog_info            = image:glance:publicURL {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance_certfile                = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance_keyfile                 = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81812]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance_num_retries             = 3 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance_request_timeout         = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] goodness_function              = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] graceful_shutdown_timeout      = 5 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] group_api_class                = cinder.group.api.API {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] host                           = devstack {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] image_compress_on_upload       = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] image_conversion_address_space_limit = 1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] image_conversion_cpu_limit     = 60 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] image_conversion_disable       = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] image_upload_use_cinder_backend = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] image_upload_use_internal_tenant = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] image_volume_cache_enabled     = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] image_volume_cache_max_count   = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] image_volume_cache_max_size_gb = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] init_host_max_objects_retrieval = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] instance_format                = [instance: %(uuid)s]  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] iscsi_target_flags             =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] iscsi_write_cache              = on {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] iser_helper                    = tgtadm {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] iser_ip_address                = 192.168.122.48 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] iser_port                      = 3260 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] log_color                      = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] log_config_append              = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] log_dir                        = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] log_file                       = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] log_options                    = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] log_rotate_interval            = 1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] log_rotate_interval_type       = days {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] log_rotation_type              = none {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] max_age                        = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] max_logfile_count              = 30 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] max_logfile_size_mb            = 200 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] max_over_subscription_ratio    = 20.0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] message_reap_interval          = 86400 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] message_ttl                    = 2592000 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] migration_create_volume_timeout_secs = 300 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] monkey_patch                   = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] monkey_patch_modules           = [] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] my_ip                          = 192.168.122.48 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] no_snapshot_gb_quota           = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] num_iser_scan_tries            = 3 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] num_shell_tries                = 3 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] num_volume_device_scan_tries   = 3 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] nvmeof_conn_info_version       = 1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] nvmet_ns_id                    = 10 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] nvmet_port_id                  = 1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] osapi_max_limit                = 1000 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] osapi_volume_ext_list          = [] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] osapi_volume_listen_port       = 8776 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] osapi_volume_use_ssl           = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] osapi_volume_workers           = 2 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] per_volume_size_limit          = -1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] periodic_fuzzy_delay           = 60 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] periodic_interval              = 60 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] public_endpoint                = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] publish_errors                 = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] quota_backup_gigabytes         = 1000 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] quota_backups                  = 10 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] quota_gigabytes                = 1000 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] quota_groups                   = 10 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] quota_snapshots                = 10 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] quota_volumes                  = 10 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] rate_limit_burst               = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] rate_limit_except_level        = CRITICAL {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] rate_limit_interval            = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] reinit_driver_count            = 3 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] replication_device             = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] report_discard_supported       = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] report_interval                = 120 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] reservation_clean_interval     = 86400 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] reservation_expire             = 86400 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] reserved_image_namespaces      = [] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] reserved_percentage            = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] rpc_response_timeout           = 120 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] run_external_periodic_tasks    = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] scst_target_driver             = iscsi {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] scst_target_iqn_name           = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] service_down_time              = 720 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] shell_completion               = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] snapshot_name_template         = snapshot-%s {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] split_loggers                  = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] state_path                     = /opt/stack/data/cinder {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] storage_availability_zone      = nova {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] storage_protocol               = iSCSI {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] syslog_log_facility            = LOG_USER {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] target_helper                  = lioadm {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] target_ip_address              = 192.168.122.48 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] target_port                    = 3260 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] target_protocol                = iscsi {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] target_secondary_ip_addresses  = [] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] trace_flags                    = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] transport_url                  = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] until_refresh                  = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] use_chap_auth                  = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] use_default_quota_class        = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] use_journal                    = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] use_json                       = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] use_multipath_for_image_xfer   = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] use_stderr                     = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] use_syslog                     = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] verify_glance_signatures       = enabled {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] volume_api_class               = cinder.volume.api.API {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] volume_backend_name            = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] volume_clear                   = zero {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] volume_clear_ionice            = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] volume_clear_size              = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] volume_copy_bps_limit          = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] volume_dd_blocksize            = 1M {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] volume_name_template           = volume-%s {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] volume_service_inithost_offload = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] volume_usage_audit_period      = month {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] zoning_mode                    = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_concurrency.disable_process_locking = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81812) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.admin_password = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.admin_token = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.admin_user  = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.auth_port   = 35357 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.auth_protocol = https {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.auth_section = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.auth_type   = password {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.auth_uri    = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.auth_version = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.cache       = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.certfile    = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.delay_auth_decision = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.http_connect_timeout = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.identity_uri = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.include_service_catalog = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.insecure    = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.interface   = public {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.keyfile     = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_password =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcache_username =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.region_name = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.service_token_roles_required = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.service_type = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.token_cache_time = 300 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.48/identity {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.backend                  = dogpile.cache.null {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.backend_argument         = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.backend_expiration_time  = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.config_prefix            = cache.oslo {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.debug_cache_backend      = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.enable_retry_client      = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.enable_socket_keepalive  = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.enabled                  = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.enforce_fips_mode        = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.expiration_time          = 600 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.hashclient_retry_attempts = 2 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.memcache_dead_retry      = 300 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.memcache_pool_maxsize    = 10 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.memcache_sasl_enabled    = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.password                 = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.proxies                  = [] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.redis_db                 = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.redis_sentinel_service_name = mymaster {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.redis_server             = localhost:6379 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.retry_attempts           = 2 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.retry_delay              = 0.0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.socket_keepalive_count   = 1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.socket_keepalive_idle    = 1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.socket_keepalive_interval = 1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.socket_timeout           = 1.0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.tls_allowed_ciphers      = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.tls_cafile               = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.tls_certfile             = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.tls_enabled              = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.tls_keyfile              = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cache.username                 = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] coordination.backend_url       = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.asyncio_connection    = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.asyncio_slave_connection = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.backend               = sqlalchemy {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.connection            = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.connection_debug      = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.connection_parameters =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.connection_recycle_time = 3600 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.connection_trace      = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.db_inc_retry_interval = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.db_max_retries        = 20 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.db_max_retry_interval = 10 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.db_retry_interval     = 1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.max_overflow          = 50 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.max_pool_size         = 5 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.max_retries           = 10 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.mysql_wsrep_sync_wait = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.pool_timeout          = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.retry_interval        = 10 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.slave_connection      = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.sqlite_synchronous    = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.synchronous_reader    = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] database.use_db_reconnect      = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] profiler.connection_string     = messaging:// {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] profiler.enabled               = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] profiler.es_doc_type           = notification {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] profiler.es_scroll_size        = 10000 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] profiler.es_scroll_time        = 2m {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] profiler.filter_error_trace    = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] profiler.hmac_keys             = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] profiler.sentinel_service_name = mymaster {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] profiler.socket_timeout        = 0.1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] profiler.trace_requests        = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] profiler.trace_sqlalchemy      = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] profiler_jaeger.process_tags   = {} {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] profiler_jaeger.service_name_prefix = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] profiler_otlp.service_name_prefix = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_policy.enforce_new_defaults = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: WARNING oslo_config.cfg [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_policy.enforce_scope      = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_policy.policy_default_rule = default {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_policy.policy_file        = policy.yaml {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] privsep_osbrick.group          = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] privsep_osbrick.helper_command = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] privsep_osbrick.user           = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cinder_sys_admin.group         = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cinder_sys_admin.helper_command = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] cinder_sys_admin.user          = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] service_user.auth_section      = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] service_user.auth_type         = password {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] service_user.cafile            = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] service_user.certfile          = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] service_user.collect_timing    = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] service_user.insecure          = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] service_user.keyfile           = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] service_user.send_service_user_token = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] service_user.split_loggers     = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] service_user.timeout           = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance.auth_section            = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance.auth_type               = password {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance.certfile                = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance.collect_timing          = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance.insecure                = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance.keyfile                 = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance.region_name             = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance.split_loggers           = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] glance.timeout                 = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.backend_availability_zone = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.chap_password = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.chap_username =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.disk_geometry = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.driver_client_cert = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.driver_client_cert_key = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.driver_data_namespace = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.driver_use_ssl = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.enable_unsupported_driver = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.extra_capabilities = {} {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.filter_function = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.goodness_function = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.iscsi_target_flags =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.iscsi_write_cache = on {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.iser_helper   = tgtadm {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.iser_ip_address = 192.168.122.48 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.iser_port     = 3260 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.nas_host      =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.nas_login     = admin {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.nas_mount_options = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.nas_password  = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.nas_private_key =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.nas_share_path =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.num_shell_tries = 3 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.nvmet_port_id = 1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.quobyte_client_cfg = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.quobyte_volume_url = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.replication_device = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.report_discard_supported = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.reserved_percentage = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.scst_target_driver = iscsi {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.scst_target_iqn_name = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.storage_protocol = iSCSI {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.target_helper = tgtadm {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.target_ip_address = 192.168.122.48 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.target_port   = 3260 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.target_protocol = iscsi {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.trace_flags   = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.unique_fqdn_network = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.use_chap_auth = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.volume_backend_name = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.volume_clear  = zero {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.volume_clear_ionice = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.volume_clear_size = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81812) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_reports.file_event_handler = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.quobyte [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 14 01:17:50 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.quobyte [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Running cmd (subprocess): mount.quobyte {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_reports.log_dir           = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.backend_availability_zone = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.backend_host         = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.chap_password        = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.chap_username        = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.chiscsi_conf         = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.disk_geometry        = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.driver_client_cert   = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.driver_client_cert_key = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.driver_data_namespace = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.driver_use_ssl       = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.extra_capabilities   = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.filter_function      = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.goodness_function    = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.iser_helper          = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.iser_ip_address      = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.iser_port            = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.iser_target_prefix   = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.nas_host             = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.nas_login            = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.nas_mount_options    = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.nas_password         = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.nas_private_key      = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.nas_share_path       = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.nas_ssh_port         = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.num_shell_tries      = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.nvmet_port_id        = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.replication_device   = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.report_discard_supported = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.reserved_percentage  = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.scst_target_driver   = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.storage_protocol     = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.target_helper        = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.target_ip_address    = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.target_port          = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.target_prefix        = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.target_protocol      = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.trace_flags          = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.use_chap_auth        = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.volume_clear         = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.volume_clear_size    = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] QuobyteHD.volumes_dir          = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.ssl      = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_notifications.driver = [] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_notifications.retry = -1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] oslo_messaging_notifications.transport_url = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] key_manager.fixed_key          = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.barbican_api_version  = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.barbican_endpoint     = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.barbican_endpoint_type = public {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.barbican_region_name  = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.cafile                = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.certfile              = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.collect_timing        = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.insecure              = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.keyfile               = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.number_of_retries     = 60 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.retry_delay           = 1 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.send_service_user_token = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.split_loggers         = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.timeout               = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.verify_ssl            = True {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican.verify_ssl_path       = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican_service_user.auth_section = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican_service_user.auth_type = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican_service_user.cafile   = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican_service_user.certfile = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican_service_user.collect_timing = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican_service_user.insecure = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican_service_user.keyfile  = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican_service_user.split_loggers = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] barbican_service_user.timeout  = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] vault.approle_role_id          = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] vault.approle_secret_id        = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] vault.kv_mountpoint            = secret {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] vault.kv_path                  = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] vault.kv_version               = 2 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] vault.namespace                = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] vault.root_token_id            = **** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] vault.ssl_ca_crt_file          = None {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] vault.timeout                  = 60.0 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] vault.use_ssl                  = False {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 14 01:17:50 devstack cinder-volume[81673]: DEBUG oslo_service.backend._eventlet.service [None req-f9231ee1-e285-43ae-af0a-31afa062284e None None] ******************************************************************************** {{(pid=81673) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 14 01:17:50 devstack quobyte-client[81842]: Reading configuration file: /etc/quobyte/client.cfg
Apr 14 01:17:50 devstack quobyte-client[81842]: Invalid parameters found, error: missing mount point.
Apr 14 01:17:50 devstack quobyte-client[81842]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 14 01:17:50 devstack quobyte-client[81842]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] CMD "mount.quobyte" returned: 1 in 0.109s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:17:50 devstack sudo[81847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:17:50 devstack sudo[81847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:17:50 devstack sudo[81847]: pam_unix(sudo:session): session closed for user root
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.486s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:17:50 devstack cinder-volume[81812]: INFO cinder.volume.driver [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Driver hasn't implemented _init_vendor_properties()
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG cinder.volume.driver [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7474403381348, 'free_capacity_gb': 1775.7474403381348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81812) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG oslo_db.sqlalchemy.engines [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81812) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writer thread running {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG cinder.db.sqlalchemy.api [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Building query based on filter {{(pid=81812) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81812) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:17:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:17:50 devstack cinder-volume[81812]: INFO cinder.keymgr.migration [None req-2d3e293d-c909-4281-8a71-f9434a7ed954 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 14 01:17:50 devstack sudo[81892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:17:50 devstack sudo[81892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:17:51 devstack sudo[81892]: pam_unix(sudo:session): session closed for user root
Apr 14 01:17:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.412s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:17:51 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:17:51 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Driver initialization completed successfully.
Apr 14 01:17:51 devstack cinder-volume[81812]: INFO cinder.manager [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Initiating service 3 cleanup
Apr 14 01:17:51 devstack cinder-volume[81812]: INFO cinder.manager [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Service 3 cleanup completed.
Apr 14 01:17:51 devstack cinder-volume[81812]: DEBUG cinder.service [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Creating RPC server for service cinder-volume {{(pid=81812) start /opt/stack/cinder/cinder/service.py:231}}
Apr 14 01:17:51 devstack cinder-volume[81812]: DEBUG cinder.service [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81812) start /opt/stack/cinder/cinder/service.py:237}}
Apr 14 01:17:51 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 14 01:17:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:17:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:17:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:17:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:17:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:17:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:17:51 devstack sudo[81909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:17:51 devstack sudo[81909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:17:51 devstack sudo[81909]: pam_unix(sudo:session): session closed for user root
Apr 14 01:17:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.454s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:17:51 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9a3ff436-a1ad-46b6-8259-897060e27f96 None None] Driver post RPC initialization completed successfully.
Apr 14 01:18:00 devstack cinder-volume[81673]: DEBUG dbcounter [-] [81673] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81673) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:18:01 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:SELECT=2 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:18:01 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Flow 'volume_create_manager' (59af2bfc-48c4-4160-a1e1-9c2f7fa60abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869602df-8d22-4003-83bf-bd774aa6c399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869602df-8d22-4003-83bf-bd774aa6c399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-17021106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251ea119-f82c-4385-8f41-09b92f8d6676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e49e07ce6872486aae2402e2156be298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:18:51Z,use_quota=True,user_id='f634a5138f6f4183b8ea3f8870508b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef15e7d-6aca-4e9a-9da9-a2139353ff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef15e7d-6aca-4e9a-9da9-a2139353ff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0720cb2-4387-4d1c-ac19-9f3f2798e926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0720cb2-4387-4d1c-ac19-9f3f2798e926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251ea119-f82c-4385-8f41-09b92f8d6676', 'volume_name': 'volume-251ea119-f82c-4385-8f41-09b92f8d6676', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84065df8-9264-4c0b-9dfd-467c6cad65ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84065df8-9264-4c0b-9dfd-467c6cad65ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0477190-f97c-4e72-bcc1-ebbd6eec97f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:51 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Volume 251ea119-f82c-4385-8f41-09b92f8d6676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251ea119-f82c-4385-8f41-09b92f8d6676', 'volume_size': 1}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-17021106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251ea119-f82c-4385-8f41-09b92f8d6676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e49e07ce6872486aae2402e2156be298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:18:51Z,use_quota=True,user_id='f634a5138f6f4183b8ea3f8870508b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Creating volume 251ea119-f82c-4385-8f41-09b92f8d6676 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:18:51 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:18:51 devstack sudo[82204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676 1073741824
Apr 14 01:18:51 devstack sudo[82204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Flow 'volume_create_manager' (049dc355-c005-4056-8c34-111eb87529b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64bf0d3-1509-4096-86ad-66b175826d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64bf0d3-1509-4096-86ad-66b175826d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2061511980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b55c844-9c73-4b39-bd96-33c11df7d47b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3968086a2443b5842d6d04c01478bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:18:51Z,use_quota=True,user_id='cd92bc82027b4ff79e217d88aa9cf703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7c4bf1-4255-40f2-be7a-90e613560c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7c4bf1-4255-40f2-be7a-90e613560c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57a0bb6-d3cd-4827-9591-7e775f76ae54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57a0bb6-d3cd-4827-9591-7e775f76ae54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b55c844-9c73-4b39-bd96-33c11df7d47b', 'volume_name': 'volume-6b55c844-9c73-4b39-bd96-33c11df7d47b', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bc6967-27f7-43d9-a018-b5384fd71fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bc6967-27f7-43d9-a018-b5384fd71fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78783b00-0dff-4cb0-b0cc-ebcc9e7bb321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:51 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Volume 6b55c844-9c73-4b39-bd96-33c11df7d47b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b55c844-9c73-4b39-bd96-33c11df7d47b', 'volume_size': 1}
Apr 14 01:18:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:18:51 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e2e60164-057b-4162-b051-b95f08fdb53e tempest-GroupSnapshotsV319Test-1176934322 None] Group tempest-GroupSnapshotsV319Test-Group-1342586145: creating
Apr 14 01:18:52 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e2e60164-057b-4162-b051-b95f08fdb53e tempest-GroupSnapshotsV319Test-1176934322 None] Group tempest-GroupSnapshotsV319Test-Group-1342586145: created successfully
Apr 14 01:18:52 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e2e60164-057b-4162-b051-b95f08fdb53e tempest-GroupSnapshotsV319Test-1176934322 None] Create group completed successfully.
Apr 14 01:18:52 devstack sudo[82204]: pam_unix(sudo:session): session closed for user root
Apr 14 01:18:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676 1073741824" returned: 0 in 1.058s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:18:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:18:52 devstack sudo[82524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676
Apr 14 01:18:52 devstack sudo[82524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:18:53 devstack sudo[82524]: pam_unix(sudo:session): session closed for user root
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676" returned: 0 in 0.790s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.795s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2061511980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b55c844-9c73-4b39-bd96-33c11df7d47b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3968086a2443b5842d6d04c01478bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:18:51Z,use_quota=True,user_id='cd92bc82027b4ff79e217d88aa9cf703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Creating volume 6b55c844-9c73-4b39-bd96-33c11df7d47b {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:18:53 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6b55c844-9c73-4b39-bd96-33c11df7d47b 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0477190-f97c-4e72-bcc1-ebbd6eec97f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251ea119-f82c-4385-8f41-09b92f8d6676', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3613b14c-13a0-4f92-9b00-d68fb013e205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:53 devstack sudo[82528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6b55c844-9c73-4b39-bd96-33c11df7d47b 1073741824
Apr 14 01:18:53 devstack sudo[82528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:18:53 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Volume volume-251ea119-f82c-4385-8f41-09b92f8d6676 (251ea119-f82c-4385-8f41-09b92f8d6676): created successfully
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3613b14c-13a0-4f92-9b00-d68fb013e205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Flow 'volume_create_manager' (59af2bfc-48c4-4160-a1e1-9c2f7fa60abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:18:53 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-7964f1aa-d599-4ca0-b80d-25a4287af369 tempest-DeleteServersTestJSON-301922479 None] Created volume successfully.
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Flow 'volume_create_manager' (b175c50d-66cd-4d3c-b25a-55aa4c984465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8578675e-630d-4ac6-b7c6-fb54ad3587dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8578675e-630d-4ac6-b7c6-fb54ad3587dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-42987031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb6e12cb-ba42-41a4-932a-572561fed3ae,host='devstack@QuobyteHD#QuobyteHD',id=e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d8aaaee3b654f01b379b3d43c62ddda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:18:54Z,use_quota=True,user_id='c7398d687ad149ffb0596ac2ed55d5a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be240a1-216e-4549-a090-c56d6f2adb13),volume_type_id=5be240a1-216e-4549-a090-c56d6f2adb13)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36857208-8213-4dcf-8ee8-3cec83e3f002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36857208-8213-4dcf-8ee8-3cec83e3f002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2778243-5d13-4512-b293-f9dd02d7080f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2778243-5d13-4512-b293-f9dd02d7080f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8', 'volume_name': 'volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fcb608-e971-443c-9621-b726a8061986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fcb608-e971-443c-9621-b726a8061986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03aa072e-f1e0-4e06-81a7-ba67941d03f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:54 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Volume e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8', 'volume_size': 1}
Apr 14 01:18:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:18:55 devstack sudo[82528]: pam_unix(sudo:session): session closed for user root
Apr 14 01:18:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6b55c844-9c73-4b39-bd96-33c11df7d47b 1073741824" returned: 0 in 1.655s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:18:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6b55c844-9c73-4b39-bd96-33c11df7d47b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:18:55 devstack sudo[82562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6b55c844-9c73-4b39-bd96-33c11df7d47b
Apr 14 01:18:55 devstack sudo[82562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:18:56 devstack sudo[82562]: pam_unix(sudo:session): session closed for user root
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6b55c844-9c73-4b39-bd96-33c11df7d47b" returned: 0 in 0.885s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] <== create_volume: return (2646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.651s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.055s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eb6e12cb-ba42-41a4-932a-572561fed3ae,created_at=2026-04-13T23:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-42987031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb6e12cb-ba42-41a4-932a-572561fed3ae,host='devstack@QuobyteHD#QuobyteHD',id=e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d8aaaee3b654f01b379b3d43c62ddda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:18:54Z,use_quota=True,user_id='c7398d687ad149ffb0596ac2ed55d5a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be240a1-216e-4549-a090-c56d6f2adb13),volume_type_id=5be240a1-216e-4549-a090-c56d6f2adb13)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Creating volume e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:18:56 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78783b00-0dff-4cb0-b0cc-ebcc9e7bb321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b55c844-9c73-4b39-bd96-33c11df7d47b', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f840a094-ac98-48ff-abf2-d1d566ef5d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:56 devstack sudo[82570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 1073741824
Apr 14 01:18:56 devstack sudo[82570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:18:56 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Volume volume-6b55c844-9c73-4b39-bd96-33c11df7d47b (6b55c844-9c73-4b39-bd96-33c11df7d47b): created successfully
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f840a094-ac98-48ff-abf2-d1d566ef5d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:56 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Flow 'volume_create_manager' (049dc355-c005-4056-8c34-111eb87529b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:18:56 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-df20499a-249b-49de-a362-9f67d4dcbdb0 tempest-VolumesAdminNegativeTest-773264822 None] Created volume successfully.
Apr 14 01:18:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Acquiring lock "cinder-6b55c844-9c73-4b39-bd96-33c11df7d47b-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:18:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Lock "cinder-6b55c844-9c73-4b39-bd96-33c11df7d47b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:18:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Acquiring lock "cinder-quobyte-6b55c844-9c73-4b39-bd96-33c11df7d47b" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:18:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Lock "cinder-quobyte-6b55c844-9c73-4b39-bd96-33c11df7d47b" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:18:57 devstack cinder-volume[81812]: INFO oslo.privsep.daemon [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyrus9l81/privsep.sock']
Apr 14 01:18:57 devstack sudo[82590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyrus9l81/privsep.sock
Apr 14 01:18:57 devstack sudo[82590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:18:57 devstack sudo[82570]: pam_unix(sudo:session): session closed for user root
Apr 14 01:18:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 1073741824" returned: 0 in 1.548s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:18:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:18:57 devstack sudo[82592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8
Apr 14 01:18:57 devstack sudo[82592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 14 01:18:58 devstack cinder-volume[81812]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 14 01:18:58 devstack sudo[82592]: pam_unix(sudo:session): session closed for user root
Apr 14 01:18:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8" returned: 0 in 0.745s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:18:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:18:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:18:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03aa072e-f1e0-4e06-81a7-ba67941d03f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db010f02-48ad-47c0-8e20-5a044e952544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:18:58 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Volume volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 (e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8): created successfully
Apr 14 01:18:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db010f02-48ad-47c0-8e20-5a044e952544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:18:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Flow 'volume_create_manager' (b175c50d-66cd-4d3c-b25a-55aa4c984465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:18:58 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-28a6dc2d-e9b7-465e-bedf-7491a4663b34 tempest-GroupSnapshotsV319Test-1176934322 None] Created volume successfully.
Apr 14 01:18:59 devstack sudo[82590]: pam_unix(sudo:session): session closed for user root
Apr 14 01:18:59 devstack cinder-volume[81812]: INFO oslo.privsep.daemon [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Spawned new privsep daemon via rootwrap
Apr 14 01:18:59 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Accepted privsep connection to /tmp/tmpyrus9l81/privsep.sock {{(pid=81812) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 14 01:18:59 devstack cinder-volume[81812]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 01:18:59 devstack cinder-volume[81812]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 01:18:59 devstack cinder-volume[81812]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 14 01:18:59 devstack cinder-volume[81812]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82599
Apr 14 01:18:59 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[23013e47-6231-4feb-ba20-7cfe3322d166]: (2,) {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:18:59 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8bcd7e-491e-4a14-9eb4-0857b9b542ee]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:18:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6b55c844-9c73-4b39-bd96-33c11df7d47b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:18:59 devstack sudo[82609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6b55c844-9c73-4b39-bd96-33c11df7d47b
Apr 14 01:18:59 devstack sudo[82609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:18:59 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] GroupSnapshot 9cd129c4-86b7-4691-b53c-8867b2d89810: creating.
Apr 14 01:18:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] Group snapshot 9cd129c4-86b7-4691-b53c-8867b2d89810: creating. {{(pid=81812) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 14 01:18:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:18:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:18:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] Creating offline snapshot c2ae083f-ddd7-463e-8044-1b3dec4e73a0 of volume e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:19:00 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8a7093-0cb1-49db-834d-317a33548e79]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:00 devstack sudo[82616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8
Apr 14 01:19:00 devstack sudo[82616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:00 devstack sudo[82609]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6b55c844-9c73-4b39-bd96-33c11df7d47b" returned: 0 in 1.082s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6b55c844-9c73-4b39-bd96-33c11df7d47b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:00 devstack sudo[82618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6b55c844-9c73-4b39-bd96-33c11df7d47b
Apr 14 01:19:00 devstack sudo[82618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:00 devstack cinder-volume[81812]: WARNING py.warnings [req-716021c3-edd8-4142-95ae-0ac99b85b3df req-70a487dd-06b6-4aa7-8d99-719a5fe5f7b5 tempest-DeleteServersTestJSON-301922479 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Apr 14 01:19:00 devstack cinder-volume[81812]:   .first()
Apr 14 01:19:00 devstack cinder-volume[81812]: 
Apr 14 01:19:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-716021c3-edd8-4142-95ae-0ac99b85b3df req-70a487dd-06b6-4aa7-8d99-719a5fe5f7b5 tempest-DeleteServersTestJSON-301922479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:01 devstack sudo[82616]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8" returned: 0 in 1.380s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:01 devstack sudo[82661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0 1G
Apr 14 01:19:01 devstack sudo[82661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:01 devstack sudo[82618]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6b55c844-9c73-4b39-bd96-33c11df7d47b" returned: 0 in 1.278s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Lock "cinder-quobyte-6b55c844-9c73-4b39-bd96-33c11df7d47b" released by "delete_volume" :: held 3.944s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:01 devstack cinder-volume[81812]: WARNING cinder.quota [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:19:01 devstack cinder-volume[81812]: WARNING cinder.quota [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:19:01 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Created reservations ['9c6d4afa-7ece-4eb8-8e25-59624ce13d22', '7ac4fc87-2a1a-44a3-807a-78c655a9c24a', '6007a3a9-169f-4f67-8cfc-6fdfcfb325cd', 'e8ac7a70-050e-4e31-bc26-8be15b0d11f0'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:19:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:01 devstack sudo[82664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:19:01 devstack sudo[82664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:02 devstack sudo[82661]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0 1G" returned: 0 in 0.777s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:02 devstack sudo[82669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0
Apr 14 01:19:02 devstack sudo[82669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:02 devstack sudo[82664]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.702s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:02 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:19:02 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Deleted volume successfully.
Apr 14 01:19:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eccc38da-7a7a-4d2e-aef1-d475503736a0 tempest-VolumesAdminNegativeTest-773264822 None] Lock "cinder-6b55c844-9c73-4b39-bd96-33c11df7d47b-delete_volume" released by "delete_volume" :: held 4.938s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:03 devstack sudo[82669]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0" returned: 0 in 0.854s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:03 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0 is being set with open permissions: ugo+rw: NotImplementedError
Apr 14 01:19:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:03 devstack sudo[82696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0
Apr 14 01:19:03 devstack sudo[82696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:03 devstack cinder-volume[81812]: DEBUG oslo_service.periodic_task [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81812) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:19:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:03 devstack sudo[82696]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0" returned: 0 in 0.992s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:04 devstack sudo[82727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:19:04 devstack sudo[82727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:04 devstack sudo[82729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.info
Apr 14 01:19:04 devstack sudo[82729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:04 devstack sudo[82727]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.651s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:04 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:19:04 devstack sudo[82729]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.info" returned: 0 in 0.750s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:04 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 14 01:19:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:04 devstack sudo[82740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.info
Apr 14 01:19:04 devstack sudo[82740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:05 devstack sudo[82740]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.info" returned: 0 in 0.594s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.472s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-716021c3-edd8-4142-95ae-0ac99b85b3df req-70a487dd-06b6-4aa7-8d99-719a5fe5f7b5 tempest-DeleteServersTestJSON-301922479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.711s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:05 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[848ef12d-c4d5-4a7f-9b80-46a43799b11a]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-716021c3-edd8-4142-95ae-0ac99b85b3df req-70a487dd-06b6-4aa7-8d99-719a5fe5f7b5 tempest-DeleteServersTestJSON-301922479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:05 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-732396f1-94b9-4bfc-a382-3d188acb0673 tempest-GroupSnapshotsV319Test-1176934322 None] group_snapshot 9cd129c4-86b7-4691-b53c-8867b2d89810: created successfully
Apr 14 01:19:05 devstack sudo[82744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676
Apr 14 01:19:05 devstack sudo[82744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:06 devstack sudo[82744]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-716021c3-edd8-4142-95ae-0ac99b85b3df req-70a487dd-06b6-4aa7-8d99-719a5fe5f7b5 tempest-DeleteServersTestJSON-301922479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676" returned: 0 in 0.769s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-716021c3-edd8-4142-95ae-0ac99b85b3df req-70a487dd-06b6-4aa7-8d99-719a5fe5f7b5 tempest-DeleteServersTestJSON-301922479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.796s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-716021c3-edd8-4142-95ae-0ac99b85b3df req-70a487dd-06b6-4aa7-8d99-719a5fe5f7b5 tempest-DeleteServersTestJSON-301922479 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45', 'name': 'volume-251ea119-f82c-4385-8f41-09b92f8d6676', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '663e6b2d-c47d-4410-bd15-0b7d428c2928', 'enforce_multipath': True} {{(pid=81812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 14 01:19:06 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-716021c3-edd8-4142-95ae-0ac99b85b3df req-70a487dd-06b6-4aa7-8d99-719a5fe5f7b5 tempest-DeleteServersTestJSON-301922479 None] attachment_update completed successfully.
Apr 14 01:19:07 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] group_snapshot 9cd129c4-86b7-4691-b53c-8867b2d89810: deleting
Apr 14 01:19:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] group_snapshot 9cd129c4-86b7-4691-b53c-8867b2d89810: deleting {{(pid=81812) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 14 01:19:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Acquiring lock "cinder-quobyte-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Lock "cinder-quobyte-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Acquiring lock "cinder-quobyte-c2ae083f-ddd7-463e-8044-1b3dec4e73a0" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Lock "cinder-quobyte-c2ae083f-ddd7-463e-8044-1b3dec4e73a0" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Deleting offline snapshot c2ae083f-ddd7-463e-8044-1b3dec4e73a0 of volume e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:19:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] snapshot_file for this snap is: volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:19:07 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe61434c-21ee-4d31-8b1a-f3c4d84f6c94]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:07 devstack sudo[82818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0
Apr 14 01:19:07 devstack sudo[82818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:08 devstack sudo[82818]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0" returned: 0 in 0.864s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:19:08 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e30a464-c58d-4a1c-9d47-6bbf0a9b68f4]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:08 devstack sudo[83145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8
Apr 14 01:19:08 devstack sudo[83145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:08 devstack sudo[83145]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8" returned: 0 in 0.646s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:08 devstack sudo[83166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0
Apr 14 01:19:08 devstack sudo[83166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:09 devstack sudo[83166]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0" returned: 0 in 0.803s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:09 devstack sudo[83172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0
Apr 14 01:19:09 devstack sudo[83172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:10 devstack sudo[83172]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8.c2ae083f-ddd7-463e-8044-1b3dec4e73a0" returned: 0 in 0.570s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Lock "cinder-quobyte-c2ae083f-ddd7-463e-8044-1b3dec4e73a0" released by "_delete_snapshot" :: held 3.031s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Lock "cinder-quobyte-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8" released by "delete_snapshot" :: held 3.047s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:10 devstack cinder-volume[81812]: WARNING cinder.quota [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-390959419 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-390959419, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:19:10 devstack cinder-volume[81812]: WARNING cinder.quota [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-390959419 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-390959419, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:19:10 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] Created reservations ['ec1a2fd0-5733-4fb0-856d-47efc61e5b60', '71da4388-d6a2-48a4-a8da-5c79dfd8b0bd', '5a50026e-b302-4623-86bc-b9785ee2169d', '7c5c2eaa-5b80-4c9f-be63-21fbbaaf3068'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:19:10 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-14f0b785-24b0-41b9-a6c1-f92f54e0be3b tempest-GroupSnapshotsV319Test-1176934322 None] group_snapshot 9cd129c4-86b7-4691-b53c-8867b2d89810: deleted successfully
Apr 14 01:19:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Acquiring lock "cinder-quobyte-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Lock "cinder-quobyte-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8" acquired by "delete_volume" :: waited 0.026s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:11 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcb859f-481d-46bd-ae78-645689b85dd9]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:11 devstack sudo[83208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8
Apr 14 01:19:11 devstack sudo[83208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:12 devstack sudo[83208]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8" returned: 0 in 1.194s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:12 devstack sudo[83244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8
Apr 14 01:19:12 devstack sudo[83244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:13 devstack sudo[83244]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8" returned: 0 in 0.575s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Lock "cinder-quobyte-e31c87eb-1ce8-44d3-84a6-fcc5c94afaf8" released by "delete_volume" :: held 1.940s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:13 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Created reservations ['19db8d9a-1b14-426f-b70f-b04872799f6c'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:19:13 devstack cinder-volume[81812]: WARNING cinder.quota [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-390959419 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-390959419, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:19:13 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Created reservations ['165ab324-ba2b-459a-be19-f201dc4c064b', 'e5fec2f1-e6ab-4db0-950d-55af3c17908f', 'eecd7069-a162-4440-8924-0134d7d58033', '959803d6-7362-4b28-8ba0-8167d7e04ba5'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:19:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:13 devstack sudo[83281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:19:13 devstack sudo[83281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:14 devstack sudo[83281]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.714s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:14 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:19:14 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c68d397e-ebfa-47c7-86ad-7b857fa6f2b9 tempest-GroupSnapshotsV319Test-1176934322 None] Delete group completed successfully.
Apr 14 01:19:15 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-90e94130-887c-43e4-b1c2-5808c0c4b82e req-04fb7848-b31a-46f6-984e-7ff7d9e7fe2f tempest-DeleteServersTestJSON-301922479 None] Terminate volume connection completed successfully.
Apr 14 01:19:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-90e94130-887c-43e4-b1c2-5808c0c4b82e req-04fb7848-b31a-46f6-984e-7ff7d9e7fe2f tempest-DeleteServersTestJSON-301922479 None] Deleting attachment 663e6b2d-c47d-4410-bd15-0b7d428c2928. {{(pid=81812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Flow 'volume_create_manager' (88734f57-3071-425c-9a8b-2e11955980bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b4e68a-f7cf-45cb-9c7e-0fc158e2dc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b4e68a-f7cf-45cb-9c7e-0fc158e2dc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-57971175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e223d836-f1fd-42d5-8527-6220eb311d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb303e4c1394be0b419c497007a76f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:19:19Z,use_quota=True,user_id='70f9e10c72e44494bb30282c44147517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc9813e-c0f5-4eed-ac20-ff99742dcf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc9813e-c0f5-4eed-ac20-ff99742dcf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d98cc4f-13ae-4774-8e01-8bce99260251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d98cc4f-13ae-4774-8e01-8bce99260251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e223d836-f1fd-42d5-8527-6220eb311d07', 'volume_name': 'volume-e223d836-f1fd-42d5-8527-6220eb311d07', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca4526a-4d25-4142-b098-8b9cf78e20ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca4526a-4d25-4142-b098-8b9cf78e20ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c728767-7080-4ab7-b6dc-72d719b0f896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:19 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Volume e223d836-f1fd-42d5-8527-6220eb311d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e223d836-f1fd-42d5-8527-6220eb311d07', 'volume_size': 1}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-57971175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e223d836-f1fd-42d5-8527-6220eb311d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb303e4c1394be0b419c497007a76f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:19:19Z,use_quota=True,user_id='70f9e10c72e44494bb30282c44147517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Creating volume e223d836-f1fd-42d5-8527-6220eb311d07 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:19:19 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:19:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e223d836-f1fd-42d5-8527-6220eb311d07 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:19 devstack sudo[83343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e223d836-f1fd-42d5-8527-6220eb311d07 1073741824
Apr 14 01:19:19 devstack sudo[83343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Acquiring lock "cinder-251ea119-f82c-4385-8f41-09b92f8d6676-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:20 devstack sudo[83343]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Lock "cinder-251ea119-f82c-4385-8f41-09b92f8d6676-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e223d836-f1fd-42d5-8527-6220eb311d07 1073741824" returned: 0 in 1.231s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Acquiring lock "cinder-quobyte-251ea119-f82c-4385-8f41-09b92f8d6676" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e223d836-f1fd-42d5-8527-6220eb311d07 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Lock "cinder-quobyte-251ea119-f82c-4385-8f41-09b92f8d6676" acquired by "delete_volume" :: waited 0.027s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:20 devstack sudo[83348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e223d836-f1fd-42d5-8527-6220eb311d07
Apr 14 01:19:20 devstack sudo[83348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:20 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[132f7cfd-95da-4114-a37e-98206a7fafa7]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:21 devstack sudo[83350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676
Apr 14 01:19:21 devstack sudo[83350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:22 devstack sudo[83350]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676" returned: 0 in 1.143s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:22 devstack sudo[83348]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e223d836-f1fd-42d5-8527-6220eb311d07" returned: 0 in 1.214s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] <== create_volume: return (2589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:19:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.593s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:22 devstack sudo[83357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676
Apr 14 01:19:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c728767-7080-4ab7-b6dc-72d719b0f896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e223d836-f1fd-42d5-8527-6220eb311d07', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:22 devstack sudo[83357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ed44af-81d0-4aa9-a7e5-c13a23955bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:22 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Volume volume-e223d836-f1fd-42d5-8527-6220eb311d07 (e223d836-f1fd-42d5-8527-6220eb311d07): created successfully
Apr 14 01:19:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ed44af-81d0-4aa9-a7e5-c13a23955bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Flow 'volume_create_manager' (88734f57-3071-425c-9a8b-2e11955980bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:19:22 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-bc8531ff-508f-4786-ba37-41049a1af5df tempest-ServerRescueNegativeTestJSON-577732668 None] Created volume successfully.
Apr 14 01:19:23 devstack sudo[83357]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-251ea119-f82c-4385-8f41-09b92f8d6676" returned: 0 in 1.140s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:23 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Lock "cinder-quobyte-251ea119-f82c-4385-8f41-09b92f8d6676" released by "delete_volume" :: held 2.317s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:23 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Created reservations ['54ad4b0f-fd31-4b8d-b3d3-57da31c68c50', 'befc8232-d344-4633-9f73-038a815acf9c', 'd1ace3d7-caeb-4f5e-9d8b-bb141cb19c16', 'd8b34754-2c79-45d0-abfe-43250ec49286'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:19:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:23 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:23 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:23 devstack sudo[83362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:19:23 devstack sudo[83362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:24 devstack sudo[83362]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.827s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:24 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:19:24 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Deleted volume successfully.
Apr 14 01:19:24 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0029626f-3bc6-4ecc-a9b3-3d01eac6207c tempest-DeleteServersTestJSON-301922479 None] Lock "cinder-251ea119-f82c-4385-8f41-09b92f8d6676-delete_volume" released by "delete_volume" :: held 3.543s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:24 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3007f9e8-8fb2-4cfe-80d6-9ad307975911 tempest-GroupsV314Test-1298503454 None] Group tempest-GroupsV314Test-Group-690985754: creating
Apr 14 01:19:24 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3007f9e8-8fb2-4cfe-80d6-9ad307975911 tempest-GroupsV314Test-1298503454 None] Group tempest-GroupsV314Test-Group-690985754: created successfully
Apr 14 01:19:24 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3007f9e8-8fb2-4cfe-80d6-9ad307975911 tempest-GroupsV314Test-1298503454 None] Create group completed successfully.
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Flow 'volume_create_manager' (ae735704-f6fa-43d4-af81-32c8b02ca229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226cf5fd-8a69-488d-b5b8-f32401f57e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226cf5fd-8a69-488d-b5b8-f32401f57e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1075850657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5330ed0f-ae0a-4fc2-9170-8e80cb0c852f,host='devstack@QuobyteHD#QuobyteHD',id=2c648e44-2486-403f-82ee-ccf404184253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94136432596d4d81831bc3d968ebb071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:19:27Z,use_quota=True,user_id='79eabd46f79643489284021eb573a1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1965018f-becf-4086-be39-76f25b000197),volume_type_id=1965018f-becf-4086-be39-76f25b000197)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc97c357-231f-48da-9abb-06f9b40e07e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc97c357-231f-48da-9abb-06f9b40e07e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae951283-cb67-43b6-97d2-f3de04820af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae951283-cb67-43b6-97d2-f3de04820af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c648e44-2486-403f-82ee-ccf404184253', 'volume_name': 'volume-2c648e44-2486-403f-82ee-ccf404184253', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f585e6b5-b199-46e9-be1c-d25aa9646ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f585e6b5-b199-46e9-be1c-d25aa9646ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a460d25c-0240-4b9e-b7a9-3f36ade9c1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:26 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Volume 2c648e44-2486-403f-82ee-ccf404184253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c648e44-2486-403f-82ee-ccf404184253', 'volume_size': 1}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5330ed0f-ae0a-4fc2-9170-8e80cb0c852f,created_at=2026-04-13T23:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1075850657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5330ed0f-ae0a-4fc2-9170-8e80cb0c852f,host='devstack@QuobyteHD#QuobyteHD',id=2c648e44-2486-403f-82ee-ccf404184253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94136432596d4d81831bc3d968ebb071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:19:27Z,use_quota=True,user_id='79eabd46f79643489284021eb573a1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1965018f-becf-4086-be39-76f25b000197),volume_type_id=1965018f-becf-4086-be39-76f25b000197)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Creating volume 2c648e44-2486-403f-82ee-ccf404184253 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:19:26 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:19:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:26 devstack sudo[83372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253 1073741824
Apr 14 01:19:26 devstack sudo[83372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:27 devstack sudo[83372]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253 1073741824" returned: 0 in 0.685s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:27 devstack sudo[83405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253
Apr 14 01:19:27 devstack sudo[83405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:28 devstack sudo[83405]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253" returned: 0 in 0.850s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:28 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:19:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:28 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a460d25c-0240-4b9e-b7a9-3f36ade9c1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c648e44-2486-403f-82ee-ccf404184253', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:28 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f961f79-423f-402e-838d-3fb223f3f3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:28 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Volume volume-2c648e44-2486-403f-82ee-ccf404184253 (2c648e44-2486-403f-82ee-ccf404184253): created successfully
Apr 14 01:19:28 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f961f79-423f-402e-838d-3fb223f3f3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:28 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Flow 'volume_create_manager' (ae735704-f6fa-43d4-af81-32c8b02ca229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:19:28 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-76c481d4-79c8-42ff-a9da-91452a4839e2 tempest-GroupsV314Test-1298503454 None] Created volume successfully.
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:30 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Cloning volume 2c648e44-2486-403f-82ee-ccf404184253 to volume 6d4b7dd7-d2ec-45ee-afb5-11568deddcce
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Creating offline snapshot 66ee534a-1c2d-4698-ae53-735f9971400f of volume 2c648e44-2486-403f-82ee-ccf404184253 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f5da1c-25df-4129-a6aa-9ffbc9bc9d15]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:30 devstack sudo[83416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:19:30 devstack sudo[83416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Flow 'volume_create_manager' (e477dfcf-d5ea-4d05-a9ab-11c6d5446dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf45b0f3-8bc4-4cd2-bc8b-7e5a4be1d272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf45b0f3-8bc4-4cd2-bc8b-7e5a4be1d272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2037887486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375ffc9f-498c-43c8-8c2a-585b4a48a5fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4994700e2db4bf7a781b1cbb3ed0416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:19:30Z,use_quota=True,user_id='12eb031d76064242ac1f0aff841a97d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9833c616-9b02-4520-b4cd-03a758ddc1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9833c616-9b02-4520-b4cd-03a758ddc1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c62e2b7c-0890-4e7c-9db2-0f4840c3d267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c62e2b7c-0890-4e7c-9db2-0f4840c3d267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '375ffc9f-498c-43c8-8c2a-585b4a48a5fc', 'volume_name': 'volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa9a9ac-5190-4a43-9b94-24eaff5ba1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa9a9ac-5190-4a43-9b94-24eaff5ba1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c2dd14-c581-4d5c-8582-abc0cd94c3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:30 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Volume 375ffc9f-498c-43c8-8c2a-585b4a48a5fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc', 'volume_size': 1}
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:30 devstack sudo[83416]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253" returned: 0 in 0.642s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:30 devstack sudo[83421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f 1G
Apr 14 01:19:30 devstack sudo[83421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:31 devstack sudo[83421]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f 1G" returned: 0 in 0.571s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c648e44-2486-403f-82ee-ccf404184253 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:31 devstack sudo[83426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c648e44-2486-403f-82ee-ccf404184253 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f
Apr 14 01:19:31 devstack sudo[83426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:31 devstack sudo[83426]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c648e44-2486-403f-82ee-ccf404184253 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f" returned: 0 in 0.580s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:31 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f is being set with open permissions: ugo+rw: NotImplementedError
Apr 14 01:19:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:32 devstack sudo[83431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f
Apr 14 01:19:32 devstack sudo[83431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:32 devstack sudo[83431]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f" returned: 0 in 0.709s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:32 devstack sudo[83464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.info
Apr 14 01:19:32 devstack sudo[83464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:33 devstack sudo[83464]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.info" returned: 0 in 0.723s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:33 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 14 01:19:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:33 devstack sudo[83468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.info
Apr 14 01:19:33 devstack sudo[83468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:33 devstack sudo[83468]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.info" returned: 0 in 0.518s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Acquiring lock "cinder-quobyte-6d4b7dd7-d2ec-45ee-afb5-11568deddcce" by "_copy_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Lock "cinder-quobyte-6d4b7dd7-d2ec-45ee-afb5-11568deddcce" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] snapshot: 66ee534a-1c2d-4698-ae53-735f9971400f, volume: 6d4b7dd7-d2ec-45ee-afb5-11568deddcce,  {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59410d7-1bbf-48ba-8769-4b1b053d9f69]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:34 devstack sudo[83471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f
Apr 14 01:19:34 devstack sudo[83471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:34 devstack sudo[83471]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f" returned: 0 in 0.859s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c648e44-2486-403f-82ee-ccf404184253(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253 {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Creating direct copy from snapshot {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8536d11-52bf-459d-8c39-fee3f73027ef]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:35 devstack sudo[83478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253
Apr 14 01:19:35 devstack sudo[83478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:35 devstack sudo[83478]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253" returned: 0 in 0.837s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:35 devstack cinder-volume[81812]: DEBUG cinder.utils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Path /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce not found in is_blk_device check {{(pid=81812) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 14 01:19:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:35 devstack sudo[83483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce
Apr 14 01:19:35 devstack sudo[83483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:40 devstack sudo[83483]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce" returned: 0 in 4.392s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:40 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfab050-63a9-46f9-a786-e5e7861bccf9]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:40 devstack sudo[83560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253
Apr 14 01:19:40 devstack sudo[83560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Acquiring lock "cinder-e223d836-f1fd-42d5-8527-6220eb311d07-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Lock "cinder-e223d836-f1fd-42d5-8527-6220eb311d07-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:41 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:SELECT=55,cinder:UPDATE=55,cinder:INSERT=10,cinder:DELETE=5 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:19:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Acquiring lock "cinder-quobyte-e223d836-f1fd-42d5-8527-6220eb311d07" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Lock "cinder-quobyte-e223d836-f1fd-42d5-8527-6220eb311d07" acquired by "delete_volume" :: waited 0.030s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:41 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c38ea38-a197-4564-ada9-6345454172fa]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e223d836-f1fd-42d5-8527-6220eb311d07 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:41 devstack sudo[83560]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253" returned: 0 in 1.351s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:41 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:19:41 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Converted 1024.00 MB image at 233.05 MB/s
Apr 14 01:19:41 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce is being set with open permissions: ugo+rw: NotImplementedError
Apr 14 01:19:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:41 devstack sudo[83566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e223d836-f1fd-42d5-8527-6220eb311d07
Apr 14 01:19:41 devstack sudo[83566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:41 devstack sudo[83567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce
Apr 14 01:19:41 devstack sudo[83567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:42 devstack sudo[83566]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e223d836-f1fd-42d5-8527-6220eb311d07" returned: 0 in 1.148s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e223d836-f1fd-42d5-8527-6220eb311d07 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:42 devstack sudo[83575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e223d836-f1fd-42d5-8527-6220eb311d07
Apr 14 01:19:42 devstack sudo[83575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:42 devstack sudo[83567]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce" returned: 0 in 1.318s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Lock "cinder-quobyte-6d4b7dd7-d2ec-45ee-afb5-11568deddcce" released by "_copy_volume_from_snapshot" :: held 8.905s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Acquiring lock "cinder-quobyte-66ee534a-1c2d-4698-ae53-735f9971400f" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Lock "cinder-quobyte-66ee534a-1c2d-4698-ae53-735f9971400f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Deleting offline snapshot 66ee534a-1c2d-4698-ae53-735f9971400f of volume 2c648e44-2486-403f-82ee-ccf404184253 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:19:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] snapshot_file for this snap is: volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:19:43 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf9982c-f515-464f-9751-7bf81310d6c0]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:43 devstack sudo[83578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f
Apr 14 01:19:43 devstack sudo[83578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:43 devstack sudo[83575]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e223d836-f1fd-42d5-8527-6220eb311d07" returned: 0 in 0.590s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:43 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Lock "cinder-quobyte-e223d836-f1fd-42d5-8527-6220eb311d07" released by "delete_volume" :: held 1.796s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:43 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:SELECT=64,cinder:UPDATE=55,cinder:INSERT=15,cinder:DELETE=2 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:19:43 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Created reservations ['492a77e0-d64a-40af-8762-d1c284e54ede', 'b41341f5-5d80-4624-96cb-e9054eb35813', '15cf4972-1570-43fe-8e85-121cad22f766', 'c9b715b1-c35c-472e-b5b9-b47e3fb247a9'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:19:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:43 devstack sudo[83583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:19:43 devstack sudo[83583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:44 devstack sudo[83578]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f" returned: 0 in 0.992s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:44 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c648e44-2486-403f-82ee-ccf404184253(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:19:44 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d5364a-714f-4f1d-923f-f3d5e024ccfb]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:44 devstack sudo[83588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253
Apr 14 01:19:44 devstack sudo[83588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:44 devstack sudo[83583]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 1.521s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:44 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:19:44 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Deleted volume successfully.
Apr 14 01:19:44 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-63558298-de48-4e38-bcf3-e2f2f00a8836 tempest-ServerRescueNegativeTestJSON-577732668 None] Lock "cinder-e223d836-f1fd-42d5-8527-6220eb311d07-delete_volume" released by "delete_volume" :: held 3.637s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:45 devstack sudo[83588]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253" returned: 0 in 1.012s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:45 devstack sudo[83601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f
Apr 14 01:19:45 devstack sudo[83601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:45 devstack sudo[83601]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f" returned: 0 in 0.753s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:45 devstack sudo[83622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f
Apr 14 01:19:45 devstack sudo[83622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:46 devstack sudo[83622]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253.66ee534a-1c2d-4698-ae53-735f9971400f" returned: 0 in 0.406s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Lock "cinder-quobyte-66ee534a-1c2d-4698-ae53-735f9971400f" released by "_delete_snapshot" :: held 3.289s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.239s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.840s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2037887486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375ffc9f-498c-43c8-8c2a-585b4a48a5fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4994700e2db4bf7a781b1cbb3ed0416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:19:30Z,use_quota=True,user_id='12eb031d76064242ac1f0aff841a97d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Creating volume 375ffc9f-498c-43c8-8c2a-585b4a48a5fc {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:19:46 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:46 devstack sudo[83625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc 1073741824
Apr 14 01:19:46 devstack sudo[83625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:46 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9c485758-be6e-4577-9c61-eab09f03ee36 tempest-GroupsV314Test-1298503454 None] Create group from source-group-5330ed0f-ae0a-4fc2-9170-8e80cb0c852f completed successfully.
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Acquiring lock "cinder-quobyte-6d4b7dd7-d2ec-45ee-afb5-11568deddcce" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Lock "cinder-quobyte-6d4b7dd7-d2ec-45ee-afb5-11568deddcce" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb44019-93f9-449d-b4e2-1580fd2b915e]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:47 devstack sudo[83625]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc 1073741824" returned: 0 in 0.772s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:47 devstack sudo[83634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce
Apr 14 01:19:47 devstack sudo[83634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:47 devstack sudo[83635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc
Apr 14 01:19:47 devstack sudo[83635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:47 devstack sudo[83634]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce" returned: 0 in 0.542s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:47 devstack sudo[83635]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc" returned: 0 in 0.447s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:19:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:47 devstack sudo[83643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce
Apr 14 01:19:47 devstack sudo[83643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c2dd14-c581-4d5c-8582-abc0cd94c3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6048f7-7ad6-494b-aff5-4420a65c3b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:47 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Volume volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc (375ffc9f-498c-43c8-8c2a-585b4a48a5fc): created successfully
Apr 14 01:19:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6048f7-7ad6-494b-aff5-4420a65c3b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Flow 'volume_create_manager' (e477dfcf-d5ea-4d05-a9ab-11c6d5446dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:19:47 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8c1178f9-1a62-4a17-8bf6-473b86fecd05 tempest-VolumesTestJSON-485702447 None] Created volume successfully.
Apr 14 01:19:47 devstack sudo[83643]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6d4b7dd7-d2ec-45ee-afb5-11568deddcce" returned: 0 in 0.440s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Lock "cinder-quobyte-6d4b7dd7-d2ec-45ee-afb5-11568deddcce" released by "delete_volume" :: held 1.008s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Created reservations ['7b3c4814-bba9-4c8b-a766-7386e06b6b78'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:19:48 devstack cinder-volume[81812]: WARNING cinder.quota [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1263402124 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1263402124, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:19:48 devstack cinder-volume[81812]: WARNING cinder.quota [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1263402124 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1263402124, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Created reservations ['cb77bc65-5019-4c54-bfcc-aa66cbcb8035', '3e5f3658-2581-4e5d-b01a-1a6105fc422f', '1e42d561-5df5-454a-993b-9d03242536c8', 'de30efd3-db93-4167-a15d-d0ca53090939'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:48 devstack sudo[83646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:19:48 devstack sudo[83646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:48 devstack sudo[83646]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.476s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:19:48 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-a1da2f14-06ce-48d9-ae33-a7e7832afec1 tempest-GroupsV314Test-1298503454 None] Delete group completed successfully.
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Flow 'volume_create_manager' (adb3d2d0-b53c-4807-b665-2d868c67bbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57294a5c-466e-4a44-b663-2e674359f5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57294a5c-466e-4a44-b663-2e674359f5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-854429980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6e337a-b547-4cb5-93de-9232fadbc6f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4994700e2db4bf7a781b1cbb3ed0416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:19:49Z,use_quota=True,user_id='12eb031d76064242ac1f0aff841a97d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6667dcc1-0865-4e88-b4f2-68394bf660c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6667dcc1-0865-4e88-b4f2-68394bf660c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c01591e-d2f7-42d4-a0c6-cbf3da2e8137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c01591e-d2f7-42d4-a0c6-cbf3da2e8137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d6e337a-b547-4cb5-93de-9232fadbc6f0', 'volume_name': 'volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ca53b1-a30c-4c0e-9296-46b69c2a8760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ca53b1-a30c-4c0e-9296-46b69c2a8760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0830041a-3a13-450a-82ab-97223c0cd10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:48 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Volume 9d6e337a-b547-4cb5-93de-9232fadbc6f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0', 'volume_size': 1}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-854429980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6e337a-b547-4cb5-93de-9232fadbc6f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4994700e2db4bf7a781b1cbb3ed0416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:19:49Z,use_quota=True,user_id='12eb031d76064242ac1f0aff841a97d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Creating volume 9d6e337a-b547-4cb5-93de-9232fadbc6f0 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:19:48 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:19:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:48 devstack sudo[83649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0 1073741824
Apr 14 01:19:48 devstack sudo[83649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:49 devstack sudo[83649]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0 1073741824" returned: 0 in 0.588s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:49 devstack sudo[83654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0
Apr 14 01:19:49 devstack sudo[83654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Acquiring lock "cinder-quobyte-2c648e44-2486-403f-82ee-ccf404184253" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Lock "cinder-quobyte-2c648e44-2486-403f-82ee-ccf404184253" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[726f88c8-7a5f-4dfc-9cda-267e699bc43d]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:49 devstack sudo[83656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253
Apr 14 01:19:49 devstack sudo[83656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:49 devstack sudo[83654]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0" returned: 0 in 0.448s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0830041a-3a13-450a-82ab-97223c0cd10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042cad96-c694-4a19-ac42-59fe49bed598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:49 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Volume volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0 (9d6e337a-b547-4cb5-93de-9232fadbc6f0): created successfully
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042cad96-c694-4a19-ac42-59fe49bed598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Flow 'volume_create_manager' (adb3d2d0-b53c-4807-b665-2d868c67bbfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:19:49 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5eae5415-7d5b-4f04-b7df-ee26c9a91222 tempest-VolumesTestJSON-485702447 None] Created volume successfully.
Apr 14 01:19:49 devstack sudo[83656]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253" returned: 0 in 0.496s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:49 devstack sudo[83662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253
Apr 14 01:19:49 devstack sudo[83662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:50 devstack sudo[83662]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2c648e44-2486-403f-82ee-ccf404184253" returned: 0 in 0.420s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Lock "cinder-quobyte-2c648e44-2486-403f-82ee-ccf404184253" released by "delete_volume" :: held 0.950s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:50 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Created reservations ['d5d8dce4-ed48-420d-8a43-0b08bc122056'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:19:50 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Created reservations ['593009aa-a044-4774-b4c9-0aecd407de16', '68da4b00-ec9e-4b9f-acd3-b34107f57a38', '7ecae12f-37a4-418d-a07e-ae3bb0b5fbc4', '8f394197-8b18-4d21-a61b-c37241b888d6'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:19:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:50 devstack sudo[83665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:19:50 devstack sudo[83665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:50 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Flow 'volume_create_manager' (76386a78-269b-495f-8f97-86ff675859d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537504da-ff63-4614-9f65-d507b0f3a9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537504da-ff63-4614-9f65-d507b0f3a9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-732290952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a793c2-3331-439c-ae8d-03bb45dceb60,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4994700e2db4bf7a781b1cbb3ed0416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:19:51Z,use_quota=True,user_id='12eb031d76064242ac1f0aff841a97d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d558aa-52a9-4f35-9df8-a9b3dec94f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d558aa-52a9-4f35-9df8-a9b3dec94f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24a79e8-e964-4835-ac81-c6fe00002158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24a79e8-e964-4835-ac81-c6fe00002158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5a793c2-3331-439c-ae8d-03bb45dceb60', 'volume_name': 'volume-e5a793c2-3331-439c-ae8d-03bb45dceb60', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46d320e-387b-4126-a12c-ed1e2dd5f588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46d320e-387b-4126-a12c-ed1e2dd5f588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684fca63-f5ab-4380-9c75-01b518069133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:51 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Volume e5a793c2-3331-439c-ae8d-03bb45dceb60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5a793c2-3331-439c-ae8d-03bb45dceb60', 'volume_size': 1}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-732290952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a793c2-3331-439c-ae8d-03bb45dceb60,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4994700e2db4bf7a781b1cbb3ed0416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:19:51Z,use_quota=True,user_id='12eb031d76064242ac1f0aff841a97d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Creating volume e5a793c2-3331-439c-ae8d-03bb45dceb60 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:19:51 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e5a793c2-3331-439c-ae8d-03bb45dceb60 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:51 devstack sudo[83665]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.635s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:19:51 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-07a15715-f98d-429f-b05d-93337f6d96dc tempest-GroupsV314Test-1298503454 None] Delete group completed successfully.
Apr 14 01:19:51 devstack sudo[83668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e5a793c2-3331-439c-ae8d-03bb45dceb60 1073741824
Apr 14 01:19:51 devstack sudo[83668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:51 devstack sudo[83668]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e5a793c2-3331-439c-ae8d-03bb45dceb60 1073741824" returned: 0 in 0.673s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e5a793c2-3331-439c-ae8d-03bb45dceb60 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:51 devstack sudo[83673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e5a793c2-3331-439c-ae8d-03bb45dceb60
Apr 14 01:19:51 devstack sudo[83673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:52 devstack sudo[83673]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e5a793c2-3331-439c-ae8d-03bb45dceb60" returned: 0 in 0.610s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:19:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684fca63-f5ab-4380-9c75-01b518069133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5a793c2-3331-439c-ae8d-03bb45dceb60', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96118a0a-2eac-4dd8-b773-b47f4236a967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:19:52 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Volume volume-e5a793c2-3331-439c-ae8d-03bb45dceb60 (e5a793c2-3331-439c-ae8d-03bb45dceb60): created successfully
Apr 14 01:19:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96118a0a-2eac-4dd8-b773-b47f4236a967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:19:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Flow 'volume_create_manager' (76386a78-269b-495f-8f97-86ff675859d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:19:52 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-160f1d65-2d81-41db-8e82-39b71f21362b tempest-VolumesTestJSON-485702447 None] Created volume successfully.
Apr 14 01:19:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Acquiring lock "cinder-e5a793c2-3331-439c-ae8d-03bb45dceb60-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Lock "cinder-e5a793c2-3331-439c-ae8d-03bb45dceb60-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Acquiring lock "cinder-quobyte-e5a793c2-3331-439c-ae8d-03bb45dceb60" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Lock "cinder-quobyte-e5a793c2-3331-439c-ae8d-03bb45dceb60" acquired by "delete_volume" :: waited 0.018s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:54 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a738c3-a60f-466c-a1d7-7ff574bee9d9]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e5a793c2-3331-439c-ae8d-03bb45dceb60 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:54 devstack sudo[83713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e5a793c2-3331-439c-ae8d-03bb45dceb60
Apr 14 01:19:54 devstack sudo[83713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:55 devstack sudo[83713]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e5a793c2-3331-439c-ae8d-03bb45dceb60" returned: 0 in 0.633s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e5a793c2-3331-439c-ae8d-03bb45dceb60 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:55 devstack sudo[83721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e5a793c2-3331-439c-ae8d-03bb45dceb60
Apr 14 01:19:55 devstack sudo[83721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:55 devstack sudo[83721]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e5a793c2-3331-439c-ae8d-03bb45dceb60" returned: 0 in 0.637s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Lock "cinder-quobyte-e5a793c2-3331-439c-ae8d-03bb45dceb60" released by "delete_volume" :: held 1.321s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:55 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Created reservations ['23e2e7aa-eb6d-439b-ba01-e3fca71c9884', 'a394027b-d7fc-4dc5-8a48-8cb40ad2aa45', '286278ad-984b-4b8a-8043-0f042b04804f', 'e84add26-dfdc-43a7-b25c-e6298ff0b692'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:19:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:55 devstack sudo[83727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:19:55 devstack sudo[83727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:56 devstack sudo[83727]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.455s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:56 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:19:56 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Deleted volume successfully.
Apr 14 01:19:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c417d8a8-0535-4f80-8df3-a335feb953e8 tempest-VolumesTestJSON-485702447 None] Lock "cinder-e5a793c2-3331-439c-ae8d-03bb45dceb60-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Acquiring lock "cinder-9d6e337a-b547-4cb5-93de-9232fadbc6f0-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Lock "cinder-9d6e337a-b547-4cb5-93de-9232fadbc6f0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Acquiring lock "cinder-quobyte-9d6e337a-b547-4cb5-93de-9232fadbc6f0" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Lock "cinder-quobyte-9d6e337a-b547-4cb5-93de-9232fadbc6f0" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:56 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf65540b-ec23-41d0-ba3d-00871597891b]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:56 devstack sudo[83730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0
Apr 14 01:19:56 devstack sudo[83730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:57 devstack sudo[83730]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0" returned: 0 in 0.602s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:57 devstack sudo[83738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0
Apr 14 01:19:57 devstack sudo[83738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:57 devstack sudo[83738]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9d6e337a-b547-4cb5-93de-9232fadbc6f0" returned: 0 in 0.471s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Lock "cinder-quobyte-9d6e337a-b547-4cb5-93de-9232fadbc6f0" released by "delete_volume" :: held 1.106s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:57 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Created reservations ['af884b16-25ff-4f3c-bbc4-e446d42b6790', '30f22e89-48af-4523-896b-f4a8908f433e', 'd7b3bf88-d2d6-4c2e-8de7-e06f2e3cdbcd', '0b29973d-6818-4ba0-adac-8bcffb776d23'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:19:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:19:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:19:57 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:19:57 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:19:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:19:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:57 devstack sudo[83742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:19:57 devstack sudo[83742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:58 devstack sudo[83742]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.485s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:58 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:19:58 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Deleted volume successfully.
Apr 14 01:19:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c7abe57-1ff0-4fdb-a242-ea482c2c7743 tempest-VolumesTestJSON-485702447 None] Lock "cinder-9d6e337a-b547-4cb5-93de-9232fadbc6f0-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:19:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Acquiring lock "cinder-375ffc9f-498c-43c8-8c2a-585b4a48a5fc-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Lock "cinder-375ffc9f-498c-43c8-8c2a-585b4a48a5fc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Acquiring lock "cinder-quobyte-375ffc9f-498c-43c8-8c2a-585b4a48a5fc" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:19:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Lock "cinder-quobyte-375ffc9f-498c-43c8-8c2a-585b4a48a5fc" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:19:58 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3446728-3b02-45a4-bc1f-de1b9c751d56]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:19:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:58 devstack sudo[83772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc
Apr 14 01:19:58 devstack sudo[83772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:19:59 devstack sudo[83772]: pam_unix(sudo:session): session closed for user root
Apr 14 01:19:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc" returned: 0 in 0.724s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:19:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:19:59 devstack sudo[83778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc
Apr 14 01:19:59 devstack sudo[83778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:00 devstack sudo[83778]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-375ffc9f-498c-43c8-8c2a-585b4a48a5fc" returned: 0 in 0.922s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:00 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Lock "cinder-quobyte-375ffc9f-498c-43c8-8c2a-585b4a48a5fc" released by "delete_volume" :: held 1.686s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:00 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Created reservations ['8e8b72d3-9342-4e21-b8e6-bfe6f50ba31e', '0198552a-14a9-4db3-9896-cdb84040b4f2', '6a45b676-cb40-4755-9cd2-43573a072085', 'b432d57e-767e-4a40-b867-6a36b05022da'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:20:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:00 devstack sudo[83788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:20:00 devstack sudo[83788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:01 devstack sudo[83788]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.682s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:01 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:20:01 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Deleted volume successfully.
Apr 14 01:20:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-bdadb89a-f63b-4ef3-baaa-3400372eba61 tempest-VolumesTestJSON-485702447 None] Lock "cinder-375ffc9f-498c-43c8-8c2a-585b4a48a5fc-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:03 devstack cinder-volume[81812]: DEBUG oslo_service.periodic_task [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81812) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:20:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:04 devstack sudo[83794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:20:04 devstack sudo[83794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:04 devstack sudo[83794]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.692s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:04 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:20:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e7527b6f-7fdd-4d2a-83e0-baabb8ee5dc4 tempest-BackendsCapabilitiesAdminTestsJSON-999737917 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7474403381348, 'free_capacity_gb': 1775.7474403381348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81812) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Flow 'volume_create_manager' (37dd0e95-eeec-49f3-ab47-ab43f07ee15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264727a7-fa66-4b52-90b8-eeef4944726c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264727a7-fa66-4b52-90b8-eeef4944726c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1196767591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bda9f623-d4d4-4055-98b0-324f2e2fa477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2fba1cae7e489fb8c40a0d8432b59e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:06Z,use_quota=True,user_id='bb25bb4692664641a3e3052f3acd2a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26b757a-6cfd-418b-95ae-ac8345c74909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26b757a-6cfd-418b-95ae-ac8345c74909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd5bb88b-1700-43eb-a24f-a49b54cb37a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd5bb88b-1700-43eb-a24f-a49b54cb37a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bda9f623-d4d4-4055-98b0-324f2e2fa477', 'volume_name': 'volume-bda9f623-d4d4-4055-98b0-324f2e2fa477', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f209e1f5-58b9-44d8-989e-ed4449617397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f209e1f5-58b9-44d8-989e-ed4449617397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185a0f2f-f1d7-4b78-9ec7-d81759e66b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:06 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Volume bda9f623-d4d4-4055-98b0-324f2e2fa477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bda9f623-d4d4-4055-98b0-324f2e2fa477', 'volume_size': 1}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1196767591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bda9f623-d4d4-4055-98b0-324f2e2fa477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2fba1cae7e489fb8c40a0d8432b59e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:06Z,use_quota=True,user_id='bb25bb4692664641a3e3052f3acd2a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Creating volume bda9f623-d4d4-4055-98b0-324f2e2fa477 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:20:06 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:06 devstack sudo[83825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477 1073741824
Apr 14 01:20:06 devstack sudo[83825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-24de04c4-b168-4d82-b452-714cf7325354 tempest-BackendsCapabilitiesAdminTestsJSON-999737917 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7474403381348, 'free_capacity_gb': 1775.7474403381348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81812) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Flow 'volume_create_manager' (059cb64b-04b0-4bbb-840b-2575441ca407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684b0c2b-45b5-46e2-bf47-b85453a4bf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684b0c2b-45b5-46e2-bf47-b85453a4bf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-25455572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0d3b7ce-7743-445f-a951-fc2fec228221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadfe6d2c2cf4c6c9317398d3a73e5cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:07Z,use_quota=True,user_id='03f52e0da797488385611561a712fc83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798336ab-764a-4b78-83ea-e254b8cefb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798336ab-764a-4b78-83ea-e254b8cefb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7484b9c1-2002-41f9-a70b-0ca80967a54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7484b9c1-2002-41f9-a70b-0ca80967a54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0d3b7ce-7743-445f-a951-fc2fec228221', 'volume_name': 'volume-e0d3b7ce-7743-445f-a951-fc2fec228221', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42655641-f468-4d20-9e00-5fcf1d205ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42655641-f468-4d20-9e00-5fcf1d205ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda5c6f9-f48f-400a-b855-3db460875d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:06 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Volume e0d3b7ce-7743-445f-a951-fc2fec228221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0d3b7ce-7743-445f-a951-fc2fec228221', 'volume_size': 1}
Apr 14 01:20:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:07 devstack sudo[83825]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477 1073741824" returned: 0 in 0.720s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:07 devstack sudo[83830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477
Apr 14 01:20:07 devstack sudo[83830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:07 devstack sudo[83830]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477" returned: 0 in 0.515s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.741s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-25455572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0d3b7ce-7743-445f-a951-fc2fec228221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadfe6d2c2cf4c6c9317398d3a73e5cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:07Z,use_quota=True,user_id='03f52e0da797488385611561a712fc83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Creating volume e0d3b7ce-7743-445f-a951-fc2fec228221 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:20:07 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e0d3b7ce-7743-445f-a951-fc2fec228221 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185a0f2f-f1d7-4b78-9ec7-d81759e66b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bda9f623-d4d4-4055-98b0-324f2e2fa477', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60ea64f-333b-415b-b4ed-2a07a7099f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:07 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Volume volume-bda9f623-d4d4-4055-98b0-324f2e2fa477 (bda9f623-d4d4-4055-98b0-324f2e2fa477): created successfully
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60ea64f-333b-415b-b4ed-2a07a7099f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Flow 'volume_create_manager' (37dd0e95-eeec-49f3-ab47-ab43f07ee15e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:07 devstack sudo[83834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e0d3b7ce-7743-445f-a951-fc2fec228221 1073741824
Apr 14 01:20:07 devstack sudo[83834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:07 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-b0af18da-81eb-4c7d-ac64-6abf3be4408e req-a6edf258-3f8c-4019-8046-36c173872500 tempest-VolumesSnapshotsTestJSON-511027908 None] Created volume successfully.
Apr 14 01:20:08 devstack sudo[83834]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e0d3b7ce-7743-445f-a951-fc2fec228221 1073741824" returned: 0 in 0.811s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e0d3b7ce-7743-445f-a951-fc2fec228221 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:08 devstack sudo[83839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e0d3b7ce-7743-445f-a951-fc2fec228221
Apr 14 01:20:08 devstack sudo[83839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:09 devstack sudo[83839]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e0d3b7ce-7743-445f-a951-fc2fec228221" returned: 0 in 0.709s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:09 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:20:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.332s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda5c6f9-f48f-400a-b855-3db460875d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0d3b7ce-7743-445f-a951-fc2fec228221', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce799c2-e768-4f18-a6ac-09166f589e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:09 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Volume volume-e0d3b7ce-7743-445f-a951-fc2fec228221 (e0d3b7ce-7743-445f-a951-fc2fec228221): created successfully
Apr 14 01:20:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce799c2-e768-4f18-a6ac-09166f589e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Flow 'volume_create_manager' (059cb64b-04b0-4bbb-840b-2575441ca407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:09 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] Creating offline snapshot 2dd41d45-04ef-40cf-9d5b-08c7577ee13c of volume bda9f623-d4d4-4055-98b0-324f2e2fa477 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:20:09 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c00d1503-c025-465a-a767-c23449014e13 tempest-VolumeQuotasNegativeTestJSON-921801264 None] Created volume successfully.
Apr 14 01:20:09 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f231afa8-2ced-45a3-8338-d5e6642ba87e]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:09 devstack sudo[83842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477
Apr 14 01:20:09 devstack sudo[83842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:09 devstack sudo[83842]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477" returned: 0 in 0.586s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:09 devstack sudo[83848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c 1G
Apr 14 01:20:09 devstack sudo[83848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:10 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8662da12-75ec-420c-9f7e-7e6ecd01dec9 tempest-GroupSnapshotsTest-1492847795 None] Group tempest-GroupSnapshotsTest-Group-432089090: creating
Apr 14 01:20:10 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8662da12-75ec-420c-9f7e-7e6ecd01dec9 tempest-GroupSnapshotsTest-1492847795 None] Group tempest-GroupSnapshotsTest-Group-432089090: created successfully
Apr 14 01:20:10 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8662da12-75ec-420c-9f7e-7e6ecd01dec9 tempest-GroupSnapshotsTest-1492847795 None] Create group completed successfully.
Apr 14 01:20:10 devstack sudo[83848]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c 1G" returned: 0 in 0.748s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bda9f623-d4d4-4055-98b0-324f2e2fa477 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:10 devstack sudo[83855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bda9f623-d4d4-4055-98b0-324f2e2fa477 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c
Apr 14 01:20:10 devstack sudo[83855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Acquiring lock "cinder-e0d3b7ce-7743-445f-a951-fc2fec228221-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Lock "cinder-e0d3b7ce-7743-445f-a951-fc2fec228221-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Acquiring lock "cinder-quobyte-e0d3b7ce-7743-445f-a951-fc2fec228221" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Lock "cinder-quobyte-e0d3b7ce-7743-445f-a951-fc2fec228221" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:10 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b206d928-2172-431b-8a30-51d76b439c30]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e0d3b7ce-7743-445f-a951-fc2fec228221 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:11 devstack sudo[83858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e0d3b7ce-7743-445f-a951-fc2fec228221
Apr 14 01:20:11 devstack sudo[83858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:11 devstack sudo[83855]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bda9f623-d4d4-4055-98b0-324f2e2fa477 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c" returned: 0 in 0.598s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:11 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c is being set with open permissions: ugo+rw
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:11 devstack sudo[83863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c
Apr 14 01:20:11 devstack sudo[83863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Flow 'volume_create_manager' (87c7b9af-f61a-426f-b6c7-f0350f66fb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce2cbcf-7375-4966-a093-37ab66ee8ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce2cbcf-7375-4966-a093-37ab66ee8ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-143756583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e26dc24f-4318-4c6c-80d2-65c00782dffc,host='devstack@QuobyteHD#QuobyteHD',id=68d4c917-0bd0-4af2-aa78-8fc8edaa48ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5a307c12d4f329a67db378a34d3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:11Z,use_quota=True,user_id='a7db5d3e77744913ab5660515123e0b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86b74138-5a5a-4986-933e-57baacd6caed),volume_type_id=86b74138-5a5a-4986-933e-57baacd6caed)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc00efe-e0d2-4380-a8ad-49b62cde60aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc00efe-e0d2-4380-a8ad-49b62cde60aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6fd9a5-cccf-4a36-bc59-1a1d284decb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6fd9a5-cccf-4a36-bc59-1a1d284decb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d4c917-0bd0-4af2-aa78-8fc8edaa48ec', 'volume_name': 'volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313812f0-d90a-4358-9da8-1eb3d4724962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313812f0-d90a-4358-9da8-1eb3d4724962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46138806-97f6-4651-ba4c-6aae5b138e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:11 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Volume 68d4c917-0bd0-4af2-aa78-8fc8edaa48ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec', 'volume_size': 1}
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:11 devstack sudo[83858]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e0d3b7ce-7743-445f-a951-fc2fec228221" returned: 0 in 0.695s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e0d3b7ce-7743-445f-a951-fc2fec228221 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:11 devstack sudo[83869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e0d3b7ce-7743-445f-a951-fc2fec228221
Apr 14 01:20:11 devstack sudo[83869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:11 devstack sudo[83863]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c" returned: 0 in 0.610s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:11 devstack sudo[83871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.info
Apr 14 01:20:11 devstack sudo[83871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:12 devstack sudo[83869]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e0d3b7ce-7743-445f-a951-fc2fec228221" returned: 0 in 0.454s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Lock "cinder-quobyte-e0d3b7ce-7743-445f-a951-fc2fec228221" released by "delete_volume" :: held 1.170s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Created reservations ['da40e8ff-e1f8-4db5-b707-6c064aa83449', '00592781-a3ed-42db-a900-fb6e101fcbec', '31be8b3f-4b57-4c18-ba02-9ffae4ea6410', 'f9e2d209-8ca2-4fd0-9eb7-93bdab6a09cd'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:12 devstack sudo[83906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:20:12 devstack sudo[83906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:12 devstack sudo[83871]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.info" returned: 0 in 0.500s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:12 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.info is being set with open permissions: ugo+rw
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:12 devstack sudo[83911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.info
Apr 14 01:20:12 devstack sudo[83911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:12 devstack sudo[83906]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.525s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:20:12 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Deleted volume successfully.
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c0292e3e-3d7d-4a8b-a43c-59db616a4ccb tempest-VolumeQuotasNegativeTestJSON-921801264 None] Lock "cinder-e0d3b7ce-7743-445f-a951-fc2fec228221-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:12 devstack sudo[83911]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.info" returned: 0 in 0.455s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.628s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.176s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e26dc24f-4318-4c6c-80d2-65c00782dffc,created_at=2026-04-13T23:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-143756583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e26dc24f-4318-4c6c-80d2-65c00782dffc,host='devstack@QuobyteHD#QuobyteHD',id=68d4c917-0bd0-4af2-aa78-8fc8edaa48ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5a307c12d4f329a67db378a34d3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:11Z,use_quota=True,user_id='a7db5d3e77744913ab5660515123e0b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86b74138-5a5a-4986-933e-57baacd6caed),volume_type_id=86b74138-5a5a-4986-933e-57baacd6caed)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Creating volume 68d4c917-0bd0-4af2-aa78-8fc8edaa48ec {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:20:12 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:20:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:12 devstack sudo[83915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec 1073741824
Apr 14 01:20:12 devstack sudo[83915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:12 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-2dc6b713-b5b6-4863-832f-e102a04fa6a8 req-fa4e37d4-ccc8-4605-91e7-9741968ad638 tempest-VolumesSnapshotsTestJSON-511027908 None] Create snapshot completed successfully
Apr 14 01:20:13 devstack sudo[83915]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec 1073741824" returned: 0 in 0.552s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:13 devstack sudo[83920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec
Apr 14 01:20:13 devstack sudo[83920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Acquiring lock "cinder-2dd41d45-04ef-40cf-9d5b-08c7577ee13c-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "cinder-2dd41d45-04ef-40cf-9d5b-08c7577ee13c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Acquiring lock "cinder-quobyte-bda9f623-d4d4-4055-98b0-324f2e2fa477" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "cinder-quobyte-bda9f623-d4d4-4055-98b0-324f2e2fa477" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Acquiring lock "cinder-quobyte-2dd41d45-04ef-40cf-9d5b-08c7577ee13c" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "cinder-quobyte-2dd41d45-04ef-40cf-9d5b-08c7577ee13c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Deleting offline snapshot 2dd41d45-04ef-40cf-9d5b-08c7577ee13c of volume bda9f623-d4d4-4055-98b0-324f2e2fa477 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] snapshot_file for this snap is: volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a235f6-8922-47a6-9dfb-56612c8f0c45]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:13 devstack sudo[83922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c
Apr 14 01:20:13 devstack sudo[83922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:13 devstack sudo[83920]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec" returned: 0 in 0.583s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46138806-97f6-4651-ba4c-6aae5b138e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5316cd0f-2519-4b15-9e6d-a861ff839e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:13 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Volume volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec (68d4c917-0bd0-4af2-aa78-8fc8edaa48ec): created successfully
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5316cd0f-2519-4b15-9e6d-a861ff839e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:13 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Flow 'volume_create_manager' (87c7b9af-f61a-426f-b6c7-f0350f66fb12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:14 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2eb80051-d1f1-4471-870d-50297a16c551 tempest-GroupSnapshotsTest-1492847795 None] Created volume successfully.
Apr 14 01:20:14 devstack sudo[83922]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c" returned: 0 in 0.619s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bda9f623-d4d4-4055-98b0-324f2e2fa477(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:20:14 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0359703-50c3-4ea7-94a4-a9515406166f]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:14 devstack sudo[83928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477
Apr 14 01:20:14 devstack sudo[83928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:14 devstack sudo[83928]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477" returned: 0 in 0.601s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:14 devstack sudo[83933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c
Apr 14 01:20:14 devstack sudo[83933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:14 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] GroupSnapshot 16aed5c2-5783-4e82-9026-28540e09c67d: creating.
Apr 14 01:20:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] Group snapshot 16aed5c2-5783-4e82-9026-28540e09c67d: creating. {{(pid=81812) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 14 01:20:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] Creating offline snapshot 941e053f-f6ff-4c7d-bae9-050bf2f4dfd3 of volume 68d4c917-0bd0-4af2-aa78-8fc8edaa48ec {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:20:15 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[791923b5-6f4a-4c9c-8a8c-da97488dde64]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:15 devstack sudo[83935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec
Apr 14 01:20:15 devstack sudo[83935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:15 devstack sudo[83933]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c" returned: 0 in 1.017s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:15 devstack sudo[83943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c
Apr 14 01:20:15 devstack sudo[83943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:15 devstack sudo[83935]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec" returned: 0 in 0.901s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:15 devstack sudo[83945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3 1G
Apr 14 01:20:16 devstack sudo[83945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:16 devstack sudo[83943]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477.2dd41d45-04ef-40cf-9d5b-08c7577ee13c" returned: 0 in 0.781s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "cinder-quobyte-2dd41d45-04ef-40cf-9d5b-08c7577ee13c" released by "_delete_snapshot" :: held 3.090s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "cinder-quobyte-bda9f623-d4d4-4055-98b0-324f2e2fa477" released by "delete_snapshot" :: held 3.107s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:16 devstack cinder-volume[81812]: WARNING cinder.quota [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:20:16 devstack cinder-volume[81812]: DEBUG cinder.quota [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Created reservations ['6729fe2e-51c6-46e6-a129-af2f62eb4c6a', 'b3383689-2b14-4b61-9568-df3e9f9c4f3e', '74d5f065-0d65-4b56-9360-ad323e16d9cb', 'fecbcb8c-291e-4fef-931b-bce1e182c549'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:20:16 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Delete snapshot completed successfully.
Apr 14 01:20:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-acb0e6b8-8362-4509-b2a2-d8251cb9b955 req-d1d87eda-4800-4132-a561-fa47187d7d5e tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "cinder-2dd41d45-04ef-40cf-9d5b-08c7577ee13c-delete_snapshot" released by "delete_snapshot" :: held 3.266s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Flow 'volume_create_manager' (aa3a76d1-7a4b-4bb6-ba42-378b04e3c68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2accbfcf-c63d-4754-a645-aaa73e7972a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2accbfcf-c63d-4754-a645-aaa73e7972a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:20:17Z,deleted=False,deleted_at=None,display_description='',display_name='5f3912a1-1aba-42c0-bd76-f9017457f2a8-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ad0900-164a-4428-984e-551275627fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c8dd93da784eb3b1f6b4a2885e2fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:17Z,use_quota=True,user_id='59155bbee3ed4a8484994bfaa5375f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6749b5ce-d8bb-4f8d-afa9-4a17b10d5811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6749b5ce-d8bb-4f8d-afa9-4a17b10d5811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b326040-a5eb-4d2c-8be5-a709fbaae3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b326040-a5eb-4d2c-8be5-a709fbaae3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ad0900-164a-4428-984e-551275627fa4', 'volume_name': 'volume-a8ad0900-164a-4428-984e-551275627fa4', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd2164b-20e1-4e49-b99f-6dcf03a04932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd2164b-20e1-4e49-b99f-6dcf03a04932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d580ee2-f61d-4681-94cf-206656a806cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:17 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Volume a8ad0900-164a-4428-984e-551275627fa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ad0900-164a-4428-984e-551275627fa4', 'volume_size': 1}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:17 devstack sudo[83945]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3 1G" returned: 0 in 1.305s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:17 devstack sudo[83953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3
Apr 14 01:20:17 devstack sudo[83953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:17 devstack sudo[83953]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3" returned: 0 in 0.572s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:17 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3 is being set with open permissions: ugo+rw: NotImplementedError
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:17 devstack sudo[83958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3
Apr 14 01:20:17 devstack sudo[83958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Acquiring lock "cinder-bda9f623-d4d4-4055-98b0-324f2e2fa477-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "cinder-bda9f623-d4d4-4055-98b0-324f2e2fa477-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Acquiring lock "cinder-quobyte-bda9f623-d4d4-4055-98b0-324f2e2fa477" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "cinder-quobyte-bda9f623-d4d4-4055-98b0-324f2e2fa477" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:18 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5f355a-2dff-4eb7-b836-49cb7360e233]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:18 devstack sudo[83960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477
Apr 14 01:20:18 devstack sudo[83960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:18 devstack sudo[83958]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3" returned: 0 in 0.572s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:18 devstack sudo[83964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.info
Apr 14 01:20:18 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:18 devstack sudo[83960]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477" returned: 0 in 0.658s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:18 devstack sudo[83969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477
Apr 14 01:20:18 devstack sudo[83969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:19 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.info" returned: 0 in 0.696s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:19 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:19 devstack sudo[83974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.info
Apr 14 01:20:19 devstack sudo[83974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:19 devstack sudo[83969]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bda9f623-d4d4-4055-98b0-324f2e2fa477" returned: 0 in 0.636s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "cinder-quobyte-bda9f623-d4d4-4055-98b0-324f2e2fa477" released by "delete_volume" :: held 1.332s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG cinder.quota [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Created reservations ['69107fe7-cceb-4d72-a091-26e6348375f5', '75397725-512d-4333-8e9d-f29838ce9861', '88d80e6c-fdc9-4f59-93a4-d24c83feeb8e', 'df45c453-84dd-4e8c-ba51-9c43337eeccc'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:19 devstack sudo[83986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:20:19 devstack sudo[83986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:19 devstack sudo[83974]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.info" returned: 0 in 0.638s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.770s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.593s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:20:17Z,deleted=False,deleted_at=None,display_description='',display_name='5f3912a1-1aba-42c0-bd76-f9017457f2a8-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ad0900-164a-4428-984e-551275627fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c8dd93da784eb3b1f6b4a2885e2fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:17Z,use_quota=True,user_id='59155bbee3ed4a8484994bfaa5375f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Creating volume a8ad0900-164a-4428-984e-551275627fa4 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:20:19 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:19 devstack sudo[83989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4 1073741824
Apr 14 01:20:19 devstack sudo[83989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:19 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ad335fdf-076c-4aee-86da-ecca5b0a6b62 tempest-GroupSnapshotsTest-1492847795 None] group_snapshot 16aed5c2-5783-4e82-9026-28540e09c67d: created successfully
Apr 14 01:20:19 devstack sudo[83986]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.465s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG cinder.manager [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:20:19 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Deleted volume successfully.
Apr 14 01:20:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-3fb07946-2303-4864-aa46-1bc6eb7d2ead req-03de7f37-6209-4c95-8f06-737ede27cd1d tempest-VolumesSnapshotsTestJSON-511027908 None] Lock "cinder-bda9f623-d4d4-4055-98b0-324f2e2fa477-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:20 devstack sudo[83989]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4 1073741824" returned: 0 in 0.774s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:20 devstack sudo[84009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4
Apr 14 01:20:20 devstack sudo[84009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:21 devstack sudo[84009]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4" returned: 0 in 0.700s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d580ee2-f61d-4681-94cf-206656a806cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ad0900-164a-4428-984e-551275627fa4', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4635d4-35a6-4e71-a401-d4da893d4c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:21 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Volume volume-a8ad0900-164a-4428-984e-551275627fa4 (a8ad0900-164a-4428-984e-551275627fa4): created successfully
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4635d4-35a6-4e71-a401-d4da893d4c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Flow 'volume_create_manager' (aa3a76d1-7a4b-4bb6-ba42-378b04e3c68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:21 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-2a35e186-9d0c-433e-8795-bdef2d9894e8 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Created volume successfully.
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-941e053f-f6ff-4c7d-bae9-050bf2f4dfd3-a645320f-9bbc-43a9-aa00-17663cc9bf66" by "_create_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-941e053f-f6ff-4c7d-bae9-050bf2f4dfd3-a645320f-9bbc-43a9-aa00-17663cc9bf66" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Creating volume a645320f-9bbc-43a9-aa00-17663cc9bf66 from snapshot 941e053f-f6ff-4c7d-bae9-050bf2f4dfd3 {{(pid=81812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-a645320f-9bbc-43a9-aa00-17663cc9bf66" by "_copy_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-a645320f-9bbc-43a9-aa00-17663cc9bf66" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] snapshot: 941e053f-f6ff-4c7d-bae9-050bf2f4dfd3, volume: a645320f-9bbc-43a9-aa00-17663cc9bf66,  {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdab434-9ce0-4256-8e40-79457d5e9dbe]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:21 devstack sudo[84012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3
Apr 14 01:20:21 devstack sudo[84012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:22 devstack sudo[84012]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3" returned: 0 in 0.648s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:20:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 14 01:20:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Creating direct copy from snapshot {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 14 01:20:22 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59d4e2a-484a-4e28-803f-457c72b9004c]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:22 devstack sudo[84017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec
Apr 14 01:20:22 devstack sudo[84017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:22 devstack sudo[84017]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec" returned: 0 in 0.581s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:22 devstack cinder-volume[81812]: DEBUG cinder.utils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Path /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66 not found in is_blk_device check {{(pid=81812) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 14 01:20:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:22 devstack sudo[84022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66
Apr 14 01:20:22 devstack sudo[84022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:23 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:20:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Flow 'volume_create_manager' (c35e0e0e-b4c7-4232-b640-2cea50222dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebf65b9-b072-4d55-abad-fc782af9758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebf65b9-b072-4d55-abad-fc782af9758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-536647303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c911895b-f2bf-4e54-85ab-6cc3448b2b24,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='261aff4b46a647bca52f66e34c4b6699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:23Z,use_quota=True,user_id='79cb1d7dea9c489d82c332c323e28b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a36868-6eb0-4b51-b6a0-c247d4560942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a36868-6eb0-4b51-b6a0-c247d4560942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0dddb7-2486-47f3-9270-9fdc3bf11213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0dddb7-2486-47f3-9270-9fdc3bf11213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c911895b-f2bf-4e54-85ab-6cc3448b2b24', 'volume_name': 'volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2416179-7cb0-4838-bc67-28d74ef71303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2416179-7cb0-4838-bc67-28d74ef71303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60451659-a70c-436c-b502-041fca09eb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:24 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Volume c911895b-f2bf-4e54-85ab-6cc3448b2b24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24', 'volume_size': 1}
Apr 14 01:20:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-58a4f2a8-8a86-40c0-9a74-3c66b449e921 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:25 devstack sudo[84022]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66" returned: 0 in 3.062s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:25 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28ce389-5299-43e6-9c40-3ea7b4d99d1f]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:25 devstack sudo[84043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec
Apr 14 01:20:25 devstack sudo[84043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:26 devstack sudo[84043]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec" returned: 0 in 0.704s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:26 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec, size 1024.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66 {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:20:26 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Converted 1024.00 MB image at 334.37 MB/s
Apr 14 01:20:26 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66 is being set with open permissions: ugo+rw: NotImplementedError
Apr 14 01:20:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:26 devstack sudo[84048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66
Apr 14 01:20:26 devstack sudo[84048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:27 devstack sudo[84048]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66" returned: 0 in 0.405s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-a645320f-9bbc-43a9-aa00-17663cc9bf66" released by "_copy_volume_from_snapshot" :: held 5.489s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-941e053f-f6ff-4c7d-bae9-050bf2f4dfd3-a645320f-9bbc-43a9-aa00-17663cc9bf66" released by "_create_volume_from_snapshot" :: held 5.524s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.549s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.858s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-536647303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c911895b-f2bf-4e54-85ab-6cc3448b2b24,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='261aff4b46a647bca52f66e34c4b6699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:23Z,use_quota=True,user_id='79cb1d7dea9c489d82c332c323e28b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Creating volume c911895b-f2bf-4e54-85ab-6cc3448b2b24 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:20:27 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:27 devstack sudo[84051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24 1073741824
Apr 14 01:20:27 devstack sudo[84051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:27 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2bd4e144-1732-49c8-a0f7-bcd89c238fb6 tempest-GroupSnapshotsTest-1492847795 None] Create group from source-snapshot-16aed5c2-5783-4e82-9026-28540e09c67d completed successfully.
Apr 14 01:20:27 devstack sudo[84051]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24 1073741824" returned: 0 in 0.497s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:27 devstack sudo[84057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24
Apr 14 01:20:27 devstack sudo[84057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-a645320f-9bbc-43a9-aa00-17663cc9bf66" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-a645320f-9bbc-43a9-aa00-17663cc9bf66" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[23453847-1961-4029-ad92-c905eed64afd]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:27 devstack sudo[84059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66
Apr 14 01:20:27 devstack sudo[84059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:28 devstack sudo[84057]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24" returned: 0 in 0.812s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:28 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:20:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-58a4f2a8-8a86-40c0-9a74-3c66b449e921 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.134s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:28 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60451659-a70c-436c-b502-041fca09eb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:28 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51e3945-9819-4573-8c15-4e68f98551c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:28 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44dcf6d-3e78-438a-9e42-d04f53dd7174]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-58a4f2a8-8a86-40c0-9a74-3c66b449e921 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:28 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Volume volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24 (c911895b-f2bf-4e54-85ab-6cc3448b2b24): created successfully
Apr 14 01:20:28 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51e3945-9819-4573-8c15-4e68f98551c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:28 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Flow 'volume_create_manager' (c35e0e0e-b4c7-4232-b640-2cea50222dad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:28 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-00f9ca12-aa44-4dd6-a194-949b46e044dd req-eabb9b06-70e9-4c5e-b14f-78bdaa0e8d7d tempest-VolumesGetTestJSON-997009664 None] Created volume successfully.
Apr 14 01:20:28 devstack sudo[84062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4
Apr 14 01:20:28 devstack sudo[84062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:28 devstack sudo[84059]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66" returned: 0 in 0.874s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:28 devstack sudo[84067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66
Apr 14 01:20:28 devstack sudo[84067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:29 devstack sudo[84062]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-58a4f2a8-8a86-40c0-9a74-3c66b449e921 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4" returned: 0 in 0.705s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-58a4f2a8-8a86-40c0-9a74-3c66b449e921 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.737s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-58a4f2a8-8a86-40c0-9a74-3c66b449e921 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45', 'name': 'volume-a8ad0900-164a-4428-984e-551275627fa4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc660324-54fa-4331-b965-adc08489ca11', 'enforce_multipath': True} {{(pid=81812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 14 01:20:29 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-d3f1c3cc-8edd-4f7c-a2f8-dfa6917b9ee3 req-58a4f2a8-8a86-40c0-9a74-3c66b449e921 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] attachment_update completed successfully.
Apr 14 01:20:29 devstack sudo[84067]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a645320f-9bbc-43a9-aa00-17663cc9bf66" returned: 0 in 0.560s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-a645320f-9bbc-43a9-aa00-17663cc9bf66" released by "delete_volume" :: held 1.457s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Created reservations ['db67db8f-b3b8-4e3e-9ee5-a8bc8565746d'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:20:29 devstack cinder-volume[81812]: WARNING cinder.quota [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-194860130 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-194860130, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:20:29 devstack cinder-volume[81812]: WARNING cinder.quota [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-194860130 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-194860130, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Created reservations ['e8972de5-0df0-43f3-9f6a-21ca331bd428', '2b3a0fc7-96ba-4c8d-8d87-e6c9b1082173', 'a1f2e9a2-af07-4e11-8cdb-c2a677434181', '9bb8d9ae-fed9-4f4c-a460-d103efb271ce'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:29 devstack sudo[84073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:20:29 devstack sudo[84073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Acquiring lock "cinder-c911895b-f2bf-4e54-85ab-6cc3448b2b24-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Lock "cinder-c911895b-f2bf-4e54-85ab-6cc3448b2b24-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Acquiring lock "cinder-quobyte-c911895b-f2bf-4e54-85ab-6cc3448b2b24" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Lock "cinder-quobyte-c911895b-f2bf-4e54-85ab-6cc3448b2b24" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e43ed5c-0029-41b1-8519-4a8b7db8d887]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:29 devstack sudo[84075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24
Apr 14 01:20:29 devstack sudo[84075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:29 devstack sudo[84073]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.586s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:29 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:20:29 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2af739a1-1cb8-4ccb-995b-dc92bbf1c6b1 tempest-GroupSnapshotsTest-1492847795 None] Delete group completed successfully.
Apr 14 01:20:30 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] group_snapshot 16aed5c2-5783-4e82-9026-28540e09c67d: deleting
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] group_snapshot 16aed5c2-5783-4e82-9026-28540e09c67d: deleting {{(pid=81812) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-941e053f-f6ff-4c7d-bae9-050bf2f4dfd3" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-941e053f-f6ff-4c7d-bae9-050bf2f4dfd3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] Deleting offline snapshot 941e053f-f6ff-4c7d-bae9-050bf2f4dfd3 of volume 68d4c917-0bd0-4af2-aa78-8fc8edaa48ec {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] snapshot_file for this snap is: volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17e3ca6-11c8-43ba-896c-3d810680e757]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:30 devstack sudo[84078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3
Apr 14 01:20:30 devstack sudo[84078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:30 devstack sudo[84075]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24" returned: 0 in 0.608s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:30 devstack sudo[84083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24
Apr 14 01:20:30 devstack sudo[84083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:30 devstack sudo[84078]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3" returned: 0 in 0.548s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7a84de-2ccf-445e-8849-ab0874e928d2]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:30 devstack sudo[84088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec
Apr 14 01:20:30 devstack sudo[84088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:30 devstack sudo[84083]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c911895b-f2bf-4e54-85ab-6cc3448b2b24" returned: 0 in 0.482s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:30 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Lock "cinder-quobyte-c911895b-f2bf-4e54-85ab-6cc3448b2b24" released by "delete_volume" :: held 1.113s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:31 devstack cinder-volume[81812]: DEBUG cinder.quota [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Created reservations ['878a622e-e8ba-4711-adf7-dc18d88f671a', '0afb41c0-5da4-44cc-955a-e44b2978f58a', '73a5dc81-6c3f-42a0-95b6-89600bf469b3', '68fa0a0e-6c36-4082-8502-eb32a68f8190'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:20:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:31 devstack sudo[84091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:20:31 devstack sudo[84091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:31 devstack sudo[84088]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec" returned: 0 in 0.586s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:31 devstack sudo[84096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3
Apr 14 01:20:31 devstack sudo[84096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:31 devstack sudo[84091]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.495s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:31 devstack cinder-volume[81812]: DEBUG cinder.manager [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:20:31 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Deleted volume successfully.
Apr 14 01:20:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-444a9040-4a0e-4d18-b948-eecf9e1c174d req-d6339e60-dc84-4a95-afe9-e6c588cd6348 tempest-VolumesGetTestJSON-997009664 None] Lock "cinder-c911895b-f2bf-4e54-85ab-6cc3448b2b24-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:31 devstack sudo[84096]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3" returned: 0 in 0.573s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:31 devstack sudo[84169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3
Apr 14 01:20:31 devstack sudo[84169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:32 devstack sudo[84169]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec.941e053f-f6ff-4c7d-bae9-050bf2f4dfd3" returned: 0 in 0.538s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:32 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-941e053f-f6ff-4c7d-bae9-050bf2f4dfd3" released by "_delete_snapshot" :: held 2.297s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:32 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec" released by "delete_snapshot" :: held 2.310s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:32 devstack cinder-volume[81812]: WARNING cinder.quota [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-194860130 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-194860130, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:20:32 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] Created reservations ['21c5d9a8-117b-4d06-b760-dbce04d38685', 'd73fec38-ec42-4bd3-bdd5-30c91bc1b50c', 'baff4e0d-ec17-4a23-a885-3cc64191ef4a', 'e55c167f-ef01-4f82-b03e-85cdb3895717'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:20:32 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3e5ae78a-5f4b-49c9-b79d-b2975f8dc2ce tempest-GroupSnapshotsTest-1492847795 None] group_snapshot 16aed5c2-5783-4e82-9026-28540e09c67d: deleted successfully
Apr 14 01:20:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec" acquired by "delete_volume" :: waited 0.015s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:33 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81d0b87-8b15-4ac9-b885-b819004f75a7]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:33 devstack sudo[84175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec
Apr 14 01:20:33 devstack sudo[84175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:34 devstack sudo[84175]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec" returned: 0 in 0.738s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:34 devstack sudo[84512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec
Apr 14 01:20:34 devstack sudo[84512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:34 devstack sudo[84512]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec" returned: 0 in 0.624s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:34 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-68d4c917-0bd0-4af2-aa78-8fc8edaa48ec" released by "delete_volume" :: held 1.410s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:34 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Created reservations ['04461b6e-8edd-4e79-9c1a-2ec82b1ed863'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:20:34 devstack cinder-volume[81812]: WARNING cinder.db.sqlalchemy.api [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-194860130']
Apr 14 01:20:34 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Created reservations ['b4b4a08f-a0d7-4ab2-8cdf-d6b1b881254a', 'e1f794c0-f7e7-42dd-b1a1-780e06a1685a', 'f662f802-6462-4798-82e9-276553ae3cdd', '0cf3245c-505e-4a75-b3a6-fee3cc348eda'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:20:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:35 devstack sudo[84521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:20:35 devstack sudo[84521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:35 devstack sudo[84521]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.736s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:35 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:20:35 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ef9f9cd2-23da-41c6-8a6b-90c786eba01f tempest-GroupSnapshotsTest-1492847795 None] Delete group completed successfully.
Apr 14 01:20:36 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3f742d4f-26ba-473d-a5aa-53b8c91899b7 tempest-GroupSnapshotsTest-1492847795 None] Group tempest-GroupSnapshotsTest-Group-1560715429: creating
Apr 14 01:20:36 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3f742d4f-26ba-473d-a5aa-53b8c91899b7 tempest-GroupSnapshotsTest-1492847795 None] Group tempest-GroupSnapshotsTest-Group-1560715429: created successfully
Apr 14 01:20:36 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3f742d4f-26ba-473d-a5aa-53b8c91899b7 tempest-GroupSnapshotsTest-1492847795 None] Create group completed successfully.
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Flow 'volume_create_manager' (11eebd01-2b0c-4409-bf76-6166b9bdcfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a430f80-233f-405e-b841-5968f5cbe4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a430f80-233f-405e-b841-5968f5cbe4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1747249199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=945e5f4f-8d1c-48de-97ca-247aa57c2fbd,host='devstack@QuobyteHD#QuobyteHD',id=7f00cf58-6a1d-49a7-9ad2-09c849f5f66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5a307c12d4f329a67db378a34d3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:38Z,use_quota=True,user_id='a7db5d3e77744913ab5660515123e0b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81c3aa43-cfae-46c1-b6e7-19b79fba06a3),volume_type_id=81c3aa43-cfae-46c1-b6e7-19b79fba06a3)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3c72a4-b97d-4391-90f3-72bfefd7bfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3c72a4-b97d-4391-90f3-72bfefd7bfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0ef011-e9e0-4d48-bf23-9ffc2d138593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0ef011-e9e0-4d48-bf23-9ffc2d138593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f00cf58-6a1d-49a7-9ad2-09c849f5f66e', 'volume_name': 'volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef47b5dc-ed75-46c8-b405-2f5173612aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef47b5dc-ed75-46c8-b405-2f5173612aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3def876c-4188-4d39-bd05-c65654dd78fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:37 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Volume 7f00cf58-6a1d-49a7-9ad2-09c849f5f66e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e', 'volume_size': 1}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=945e5f4f-8d1c-48de-97ca-247aa57c2fbd,created_at=2026-04-13T23:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1747249199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=945e5f4f-8d1c-48de-97ca-247aa57c2fbd,host='devstack@QuobyteHD#QuobyteHD',id=7f00cf58-6a1d-49a7-9ad2-09c849f5f66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5a307c12d4f329a67db378a34d3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:38Z,use_quota=True,user_id='a7db5d3e77744913ab5660515123e0b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81c3aa43-cfae-46c1-b6e7-19b79fba06a3),volume_type_id=81c3aa43-cfae-46c1-b6e7-19b79fba06a3)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Creating volume 7f00cf58-6a1d-49a7-9ad2-09c849f5f66e {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:20:37 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:20:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:37 devstack sudo[84526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e 1073741824
Apr 14 01:20:37 devstack sudo[84526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:38 devstack sudo[84526]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e 1073741824" returned: 0 in 0.688s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:38 devstack sudo[84532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e
Apr 14 01:20:38 devstack sudo[84532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:39 devstack sudo[84532]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e" returned: 0 in 0.532s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:39 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:20:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3def876c-4188-4d39-bd05-c65654dd78fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259088ac-9b13-47e8-a19e-955dca0aaf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:39 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Volume volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e (7f00cf58-6a1d-49a7-9ad2-09c849f5f66e): created successfully
Apr 14 01:20:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259088ac-9b13-47e8-a19e-955dca0aaf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Flow 'volume_create_manager' (11eebd01-2b0c-4409-bf76-6166b9bdcfab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:39 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f80e2c29-8637-404b-bd88-0b2d0a6c1750 tempest-GroupSnapshotsTest-1492847795 None] Created volume successfully.
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Flow 'volume_create_manager' (ca259c2e-19f5-4187-9fa6-cb8316b4af6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec7adf2-b6e7-46f5-aeff-4e06b6c2d941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec7adf2-b6e7-46f5-aeff-4e06b6c2d941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1289355778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=945e5f4f-8d1c-48de-97ca-247aa57c2fbd,host='devstack@QuobyteHD#QuobyteHD',id=91d10953-280b-42d4-956a-648c69784bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5a307c12d4f329a67db378a34d3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:40Z,use_quota=True,user_id='a7db5d3e77744913ab5660515123e0b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81c3aa43-cfae-46c1-b6e7-19b79fba06a3),volume_type_id=81c3aa43-cfae-46c1-b6e7-19b79fba06a3)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e208da-0329-4830-be81-b46272ce9aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e208da-0329-4830-be81-b46272ce9aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6505277e-5b15-456a-96d1-2cedc92341a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6505277e-5b15-456a-96d1-2cedc92341a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d10953-280b-42d4-956a-648c69784bd6', 'volume_name': 'volume-91d10953-280b-42d4-956a-648c69784bd6', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2a6a29-cecf-4bb8-b108-4abaa23975b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2a6a29-cecf-4bb8-b108-4abaa23975b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a072241-41ab-4922-89b1-f6dab598f0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:40 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Volume 91d10953-280b-42d4-956a-648c69784bd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d10953-280b-42d4-956a-648c69784bd6', 'volume_size': 1}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=945e5f4f-8d1c-48de-97ca-247aa57c2fbd,created_at=2026-04-13T23:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1289355778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=945e5f4f-8d1c-48de-97ca-247aa57c2fbd,host='devstack@QuobyteHD#QuobyteHD',id=91d10953-280b-42d4-956a-648c69784bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5a307c12d4f329a67db378a34d3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:40Z,use_quota=True,user_id='a7db5d3e77744913ab5660515123e0b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81c3aa43-cfae-46c1-b6e7-19b79fba06a3),volume_type_id=81c3aa43-cfae-46c1-b6e7-19b79fba06a3)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Creating volume 91d10953-280b-42d4-956a-648c69784bd6 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:20:40 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:20:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:40 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-da69e690-59fb-4e46-88cc-3c1de26dc585 tempest-GroupsTest-1886650315 None] Group tempest-Group1-1701230109: creating
Apr 14 01:20:40 devstack sudo[84535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6 1073741824
Apr 14 01:20:40 devstack sudo[84535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:40 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-da69e690-59fb-4e46-88cc-3c1de26dc585 tempest-GroupsTest-1886650315 None] Group tempest-Group1-1701230109: created successfully
Apr 14 01:20:40 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-da69e690-59fb-4e46-88cc-3c1de26dc585 tempest-GroupsTest-1886650315 None] Create group completed successfully.
Apr 14 01:20:41 devstack sudo[84535]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6 1073741824" returned: 0 in 0.673s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:41 devstack sudo[84540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6
Apr 14 01:20:41 devstack sudo[84540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:41 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-0ca5e4c9-7c62-454c-ab83-26e20dc28a09 tempest-GroupsTest-1886650315 None] Group tempest-Group2-1172354750: creating
Apr 14 01:20:41 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-0ca5e4c9-7c62-454c-ab83-26e20dc28a09 tempest-GroupsTest-1886650315 None] Group tempest-Group2-1172354750: created successfully
Apr 14 01:20:41 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-0ca5e4c9-7c62-454c-ab83-26e20dc28a09 tempest-GroupsTest-1886650315 None] Create group completed successfully.
Apr 14 01:20:41 devstack sudo[84540]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6" returned: 0 in 0.543s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:20:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:41 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:UPDATE=140,cinder:SELECT=129,cinder:INSERT=42,cinder:DELETE=5 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:20:41 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a072241-41ab-4922-89b1-f6dab598f0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d10953-280b-42d4-956a-648c69784bd6', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:41 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e99b13-7200-4c4c-b5a9-7e9c24c77ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:41 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Volume volume-91d10953-280b-42d4-956a-648c69784bd6 (91d10953-280b-42d4-956a-648c69784bd6): created successfully
Apr 14 01:20:41 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e99b13-7200-4c4c-b5a9-7e9c24c77ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:41 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Flow 'volume_create_manager' (ca259c2e-19f5-4187-9fa6-cb8316b4af6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:41 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5df45c26-7576-4078-b9e7-ba83eb85be9d tempest-GroupSnapshotsTest-1492847795 None] Created volume successfully.
Apr 14 01:20:42 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ea22143d-3f12-45ea-8990-1e1bd8a53329 tempest-GroupSnapshotsTest-1492847795 None] Update group completed successfully.
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Flow 'volume_create_manager' (23ca12e5-0092-44d3-99d5-9732706b8d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713247ad-4881-4fe4-8f20-d4491c49deb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713247ad-4881-4fe4-8f20-d4491c49deb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1729511451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=33679429-6335-4ff6-8779-3630f3879586,host='devstack@QuobyteHD#QuobyteHD',id=1368ad31-ee47-4a0a-b295-474e378cfe60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06db70e985c7480fb303c740baf7466e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:43Z,use_quota=True,user_id='c11603faeef94d60b1ae0866a168aee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e40f97fe-fb69-4855-b4a8-80ef4fd8e890),volume_type_id=e40f97fe-fb69-4855-b4a8-80ef4fd8e890)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76fcc84-6ce4-4942-b60c-9028daa1deb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76fcc84-6ce4-4942-b60c-9028daa1deb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb330e1c-c1fc-4cac-8a00-f583740d47bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb330e1c-c1fc-4cac-8a00-f583740d47bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1368ad31-ee47-4a0a-b295-474e378cfe60', 'volume_name': 'volume-1368ad31-ee47-4a0a-b295-474e378cfe60', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac05d6e-2960-40c4-aeb2-c6fb076b78bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac05d6e-2960-40c4-aeb2-c6fb076b78bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbb7910-22fc-4d01-b9d6-769d82f31275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:42 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Volume 1368ad31-ee47-4a0a-b295-474e378cfe60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1368ad31-ee47-4a0a-b295-474e378cfe60', 'volume_size': 1}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=33679429-6335-4ff6-8779-3630f3879586,created_at=2026-04-13T23:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1729511451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=33679429-6335-4ff6-8779-3630f3879586,host='devstack@QuobyteHD#QuobyteHD',id=1368ad31-ee47-4a0a-b295-474e378cfe60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06db70e985c7480fb303c740baf7466e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:43Z,use_quota=True,user_id='c11603faeef94d60b1ae0866a168aee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e40f97fe-fb69-4855-b4a8-80ef4fd8e890),volume_type_id=e40f97fe-fb69-4855-b4a8-80ef4fd8e890)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Creating volume 1368ad31-ee47-4a0a-b295-474e378cfe60 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:20:42 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:20:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1368ad31-ee47-4a0a-b295-474e378cfe60 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:42 devstack sudo[84543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1368ad31-ee47-4a0a-b295-474e378cfe60 1073741824
Apr 14 01:20:42 devstack sudo[84543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:43 devstack sudo[84543]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1368ad31-ee47-4a0a-b295-474e378cfe60 1073741824" returned: 0 in 0.560s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:43 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:SELECT=134,cinder:INSERT=26,cinder:UPDATE=169,cinder:DELETE=13 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:20:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1368ad31-ee47-4a0a-b295-474e378cfe60 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:43 devstack sudo[84548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1368ad31-ee47-4a0a-b295-474e378cfe60
Apr 14 01:20:43 devstack sudo[84548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:43 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-eab98193-d9d2-4507-8b11-9f6913c1b231 tempest-GroupSnapshotsTest-1492847795 None] Update group completed successfully.
Apr 14 01:20:44 devstack sudo[84548]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1368ad31-ee47-4a0a-b295-474e378cfe60" returned: 0 in 0.460s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:44 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:20:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbb7910-22fc-4d01-b9d6-769d82f31275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1368ad31-ee47-4a0a-b295-474e378cfe60', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dd1211-8f45-4cd9-b01d-53d6d67c3454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:44 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Volume volume-1368ad31-ee47-4a0a-b295-474e378cfe60 (1368ad31-ee47-4a0a-b295-474e378cfe60): created successfully
Apr 14 01:20:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dd1211-8f45-4cd9-b01d-53d6d67c3454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Flow 'volume_create_manager' (23ca12e5-0092-44d3-99d5-9732706b8d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:44 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-696c63cc-3f3e-4b20-b0a3-ba45e112b89b tempest-GroupsTest-1886650315 None] Created volume successfully.
Apr 14 01:20:44 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9b226aaa-3e2a-40e1-b628-c367b273e2ad tempest-GroupSnapshotsTest-1492847795 None] Update group completed successfully.
Apr 14 01:20:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Acquiring lock "cinder-quobyte-1368ad31-ee47-4a0a-b295-474e378cfe60" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Lock "cinder-quobyte-1368ad31-ee47-4a0a-b295-474e378cfe60" acquired by "delete_volume" :: waited 0.025s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:45 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f7cb12-e713-4ffd-9a7f-ca9ffdba6b5b]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1368ad31-ee47-4a0a-b295-474e378cfe60 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:45 devstack sudo[84571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1368ad31-ee47-4a0a-b295-474e378cfe60
Apr 14 01:20:45 devstack sudo[84571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:46 devstack sudo[84571]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1368ad31-ee47-4a0a-b295-474e378cfe60" returned: 0 in 0.674s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1368ad31-ee47-4a0a-b295-474e378cfe60 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:46 devstack sudo[84577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1368ad31-ee47-4a0a-b295-474e378cfe60
Apr 14 01:20:46 devstack sudo[84577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:46 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-7b0ae38f-a980-41c5-9fc7-541a2b461e07 tempest-GroupSnapshotsTest-1492847795 None] Update group completed successfully.
Apr 14 01:20:46 devstack sudo[84577]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1368ad31-ee47-4a0a-b295-474e378cfe60" returned: 0 in 0.524s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Lock "cinder-quobyte-1368ad31-ee47-4a0a-b295-474e378cfe60" released by "delete_volume" :: held 1.219s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:46 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Created reservations ['2953036c-b5c1-4a66-9b74-9041d4ba606d'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:20:46 devstack cinder-volume[81812]: WARNING cinder.quota [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-420339403 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-420339403, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:20:46 devstack cinder-volume[81812]: WARNING cinder.quota [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-420339403 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-420339403, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:20:46 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Created reservations ['ac973d82-a5a5-41de-9373-3305af9576dd', 'ac233fcc-ba60-4270-bc0a-2a3fd671d0fb', 'a2b8fc44-bccf-4f38-9a95-a481c261b9b9', 'dea8121f-755b-4c9e-9d91-ce382921365b'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:20:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:46 devstack sudo[84615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:20:46 devstack sudo[84615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:47 devstack sudo[84615]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.466s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:20:47 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3eb9c15d-55f2-4b68-b14d-b30bb7cff0f8 tempest-GroupsTest-1886650315 None] Delete group completed successfully.
Apr 14 01:20:47 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] GroupSnapshot 3568a05f-82e7-4aca-b1d2-1266920e85d7: creating.
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Group snapshot 3568a05f-82e7-4aca-b1d2-1266920e85d7: creating. {{(pid=81812) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Creating offline snapshot 6aa56ecc-04f8-43cf-b8f0-e024ad17f16d of volume 91d10953-280b-42d4-956a-648c69784bd6 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90a4994-2dc7-40f1-8db9-434b5ac66820]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:47 devstack sudo[84620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6
Apr 14 01:20:47 devstack sudo[84620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-3ae7ea4f-3e87-4943-ab87-85764de46eef tempest-GroupsTest-1886650315 None] Created reservations ['1da8f37b-778d-4909-9b79-88565629c888'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3ae7ea4f-3e87-4943-ab87-85764de46eef tempest-GroupsTest-1886650315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3ae7ea4f-3e87-4943-ab87-85764de46eef tempest-GroupsTest-1886650315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3ae7ea4f-3e87-4943-ab87-85764de46eef tempest-GroupsTest-1886650315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3ae7ea4f-3e87-4943-ab87-85764de46eef tempest-GroupsTest-1886650315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3ae7ea4f-3e87-4943-ab87-85764de46eef tempest-GroupsTest-1886650315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3ae7ea4f-3e87-4943-ab87-85764de46eef tempest-GroupsTest-1886650315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:47 devstack sudo[84622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:20:47 devstack sudo[84622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:48 devstack sudo[84620]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6" returned: 0 in 0.557s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:48 devstack sudo[84627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d 1G
Apr 14 01:20:48 devstack sudo[84627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:48 devstack sudo[84622]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3ae7ea4f-3e87-4943-ab87-85764de46eef tempest-GroupsTest-1886650315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.559s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:48 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-3ae7ea4f-3e87-4943-ab87-85764de46eef tempest-GroupsTest-1886650315 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:20:48 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3ae7ea4f-3e87-4943-ab87-85764de46eef tempest-GroupsTest-1886650315 None] Delete group completed successfully.
Apr 14 01:20:48 devstack sudo[84627]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d 1G" returned: 0 in 0.700s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d10953-280b-42d4-956a-648c69784bd6 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:48 devstack sudo[84633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d10953-280b-42d4-956a-648c69784bd6 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d
Apr 14 01:20:48 devstack sudo[84633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:49 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-6f4b171b-4c55-42ab-8368-0b7b3207274f tempest-GroupsTest-1886650315 None] Group tempest-GroupsTest-Group-326063977: creating
Apr 14 01:20:49 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-6f4b171b-4c55-42ab-8368-0b7b3207274f tempest-GroupsTest-1886650315 None] Group tempest-GroupsTest-Group-326063977: created successfully
Apr 14 01:20:49 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-6f4b171b-4c55-42ab-8368-0b7b3207274f tempest-GroupsTest-1886650315 None] Create group completed successfully.
Apr 14 01:20:49 devstack sudo[84633]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d10953-280b-42d4-956a-648c69784bd6 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d" returned: 0 in 0.561s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:49 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d is being set with open permissions: ugo+rw: NotImplementedError
Apr 14 01:20:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:49 devstack sudo[84641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d
Apr 14 01:20:49 devstack sudo[84641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:49 devstack sudo[84641]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d" returned: 0 in 0.442s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:49 devstack sudo[84644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.info
Apr 14 01:20:49 devstack sudo[84644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:50 devstack sudo[84644]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.info" returned: 0 in 0.466s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:50 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:50 devstack sudo[84647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.info
Apr 14 01:20:50 devstack sudo[84647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Flow 'volume_create_manager' (86944c62-d8fe-439b-a992-a1df2b04d02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ddb467-f55d-4719-8303-2dc71ddbca8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ddb467-f55d-4719-8303-2dc71ddbca8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2078865309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=65ae90ab-435d-4029-b365-85c193d40278,host='devstack@QuobyteHD#QuobyteHD',id=5dbb19fb-9b70-43ee-9901-0ca6ae280d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06db70e985c7480fb303c740baf7466e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:51Z,use_quota=True,user_id='c11603faeef94d60b1ae0866a168aee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(819cb1d6-3ffd-4e63-a352-916e43dc6745),volume_type_id=819cb1d6-3ffd-4e63-a352-916e43dc6745)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8dcf12-4c55-4325-979e-814fb92d32a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8dcf12-4c55-4325-979e-814fb92d32a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1181783e-323c-4885-b68e-f4cc82bee10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1181783e-323c-4885-b68e-f4cc82bee10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dbb19fb-9b70-43ee-9901-0ca6ae280d00', 'volume_name': 'volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb4a8c9-8a7c-422f-a22a-ee230f1cf41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb4a8c9-8a7c-422f-a22a-ee230f1cf41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e8196a-7ccd-434a-b818-b07d51604219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:50 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Volume 5dbb19fb-9b70-43ee-9901-0ca6ae280d00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00', 'volume_size': 1}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:50 devstack sudo[84647]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.info" returned: 0 in 0.454s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.251s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Creating offline snapshot ecfd73e7-57f5-443c-ac7c-b68948c2f662 of volume 7f00cf58-6a1d-49a7-9ad2-09c849f5f66e {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a3c45c-7c40-4564-9737-391cfcf5c138]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:50 devstack sudo[84670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e
Apr 14 01:20:50 devstack sudo[84670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:51 devstack sudo[84670]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e" returned: 0 in 0.756s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:51 devstack sudo[84707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662 1G
Apr 14 01:20:51 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:52 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662 1G" returned: 0 in 0.506s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:52 devstack sudo[84712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662
Apr 14 01:20:52 devstack sudo[84712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:52 devstack sudo[84712]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662" returned: 0 in 0.477s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:52 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662 is being set with open permissions: ugo+rw: NotImplementedError
Apr 14 01:20:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:52 devstack sudo[84717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662
Apr 14 01:20:52 devstack sudo[84717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:53 devstack sudo[84717]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662" returned: 0 in 0.471s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:53 devstack sudo[84720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.info
Apr 14 01:20:53 devstack sudo[84720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:53 devstack sudo[84720]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.info" returned: 0 in 0.465s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:53 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 14 01:20:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:53 devstack sudo[84723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.info
Apr 14 01:20:53 devstack sudo[84723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:54 devstack sudo[84723]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.info" returned: 0 in 0.609s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.431s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.526s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:54 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=65ae90ab-435d-4029-b365-85c193d40278,created_at=2026-04-13T23:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2078865309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=65ae90ab-435d-4029-b365-85c193d40278,host='devstack@QuobyteHD#QuobyteHD',id=5dbb19fb-9b70-43ee-9901-0ca6ae280d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06db70e985c7480fb303c740baf7466e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:51Z,use_quota=True,user_id='c11603faeef94d60b1ae0866a168aee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(819cb1d6-3ffd-4e63-a352-916e43dc6745),volume_type_id=819cb1d6-3ffd-4e63-a352-916e43dc6745)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:20:54 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Creating volume 5dbb19fb-9b70-43ee-9901-0ca6ae280d00 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:20:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:54 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:54 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:54 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:20:54 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:20:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:54 devstack sudo[84726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00 1073741824
Apr 14 01:20:54 devstack sudo[84726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:54 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5f3ffca5-5227-4c38-96c7-4bfa0f4d55ae tempest-GroupSnapshotsTest-1492847795 None] group_snapshot 3568a05f-82e7-4aca-b1d2-1266920e85d7: created successfully
Apr 14 01:20:54 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] group_snapshot 3568a05f-82e7-4aca-b1d2-1266920e85d7: deleting
Apr 14 01:20:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] group_snapshot 3568a05f-82e7-4aca-b1d2-1266920e85d7: deleting {{(pid=81812) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 14 01:20:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-91d10953-280b-42d4-956a-648c69784bd6" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-91d10953-280b-42d4-956a-648c69784bd6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-6aa56ecc-04f8-43cf-b8f0-e024ad17f16d" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-6aa56ecc-04f8-43cf-b8f0-e024ad17f16d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Deleting offline snapshot 6aa56ecc-04f8-43cf-b8f0-e024ad17f16d of volume 91d10953-280b-42d4-956a-648c69784bd6 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] snapshot_file for this snap is: volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[797c3702-0396-42be-84d3-c8a314cbd0f8]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:55 devstack sudo[84726]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00 1073741824" returned: 0 in 0.855s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:55 devstack sudo[84732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00
Apr 14 01:20:55 devstack sudo[84732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:55 devstack sudo[84731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d
Apr 14 01:20:55 devstack sudo[84731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:55 devstack sudo[84732]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00" returned: 0 in 0.644s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e8196a-7ccd-434a-b818-b07d51604219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce06981-ea38-44da-800d-6d1151d07e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:55 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Volume volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00 (5dbb19fb-9b70-43ee-9901-0ca6ae280d00): created successfully
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce06981-ea38-44da-800d-6d1151d07e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Flow 'volume_create_manager' (86944c62-d8fe-439b-a992-a1df2b04d02a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:55 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c3ba6321-ee2c-4e66-8167-d8248f3b602c tempest-GroupsTest-1886650315 None] Created volume successfully.
Apr 14 01:20:55 devstack sudo[84731]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d" returned: 0 in 0.844s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91d10953-280b-42d4-956a-648c69784bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b679e61b-5270-4d91-973e-8c0756765ebc]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:55 devstack sudo[84777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6
Apr 14 01:20:55 devstack sudo[84777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Flow 'volume_create_manager' (be2bcc50-fc91-4816-9cad-eabb3b74ea8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a128aba-b70a-49ac-8217-6420e3311d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a128aba-b70a-49ac-8217-6420e3311d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1919002468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=65ae90ab-435d-4029-b365-85c193d40278,host='devstack@QuobyteHD#QuobyteHD',id=a85f1a3d-2b0d-4153-8043-a275228e8d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06db70e985c7480fb303c740baf7466e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:57Z,use_quota=True,user_id='c11603faeef94d60b1ae0866a168aee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(819cb1d6-3ffd-4e63-a352-916e43dc6745),volume_type_id=819cb1d6-3ffd-4e63-a352-916e43dc6745)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a8374a-66f4-47f7-ba2f-999ff3cf9f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a8374a-66f4-47f7-ba2f-999ff3cf9f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7d577c-267a-4856-a37e-a66865fa6763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7d577c-267a-4856-a37e-a66865fa6763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a85f1a3d-2b0d-4153-8043-a275228e8d95', 'volume_name': 'volume-a85f1a3d-2b0d-4153-8043-a275228e8d95', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0609eb1-4c3b-407a-ab39-d13e15d85771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0609eb1-4c3b-407a-ab39-d13e15d85771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1311a228-eaac-4c6c-9b67-0341826bb5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:56 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Volume a85f1a3d-2b0d-4153-8043-a275228e8d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a85f1a3d-2b0d-4153-8043-a275228e8d95', 'volume_size': 1}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=65ae90ab-435d-4029-b365-85c193d40278,created_at=2026-04-13T23:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1919002468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=65ae90ab-435d-4029-b365-85c193d40278,host='devstack@QuobyteHD#QuobyteHD',id=a85f1a3d-2b0d-4153-8043-a275228e8d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06db70e985c7480fb303c740baf7466e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:20:57Z,use_quota=True,user_id='c11603faeef94d60b1ae0866a168aee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(819cb1d6-3ffd-4e63-a352-916e43dc6745),volume_type_id=819cb1d6-3ffd-4e63-a352-916e43dc6745)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Creating volume a85f1a3d-2b0d-4153-8043-a275228e8d95 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:20:56 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a85f1a3d-2b0d-4153-8043-a275228e8d95 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:56 devstack sudo[84808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a85f1a3d-2b0d-4153-8043-a275228e8d95 1073741824
Apr 14 01:20:56 devstack sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:56 devstack sudo[84777]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6" returned: 0 in 0.952s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:56 devstack sudo[84810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d
Apr 14 01:20:56 devstack sudo[84810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:57 devstack sudo[84810]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d" returned: 0 in 0.544s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:57 devstack sudo[84820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d
Apr 14 01:20:57 devstack sudo[84820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:57 devstack sudo[84808]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a85f1a3d-2b0d-4153-8043-a275228e8d95 1073741824" returned: 0 in 0.628s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a85f1a3d-2b0d-4153-8043-a275228e8d95 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:57 devstack sudo[84822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a85f1a3d-2b0d-4153-8043-a275228e8d95
Apr 14 01:20:57 devstack sudo[84822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:57 devstack sudo[84820]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6.6aa56ecc-04f8-43cf-b8f0-e024ad17f16d" returned: 0 in 0.463s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:57 devstack sudo[84822]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a85f1a3d-2b0d-4153-8043-a275228e8d95" returned: 0 in 0.432s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-6aa56ecc-04f8-43cf-b8f0-e024ad17f16d" released by "_delete_snapshot" :: held 2.880s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-91d10953-280b-42d4-956a-648c69784bd6" released by "delete_snapshot" :: held 2.895s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1311a228-eaac-4c6c-9b67-0341826bb5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85f1a3d-2b0d-4153-8043-a275228e8d95', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2a89fa-85ed-45d5-b875-e4f9dbcc38ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:57 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Volume volume-a85f1a3d-2b0d-4153-8043-a275228e8d95 (a85f1a3d-2b0d-4153-8043-a275228e8d95): created successfully
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2a89fa-85ed-45d5-b875-e4f9dbcc38ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Flow 'volume_create_manager' (be2bcc50-fc91-4816-9cad-eabb3b74ea8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-ecfd73e7-57f5-443c-ac7c-b68948c2f662" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:20:57 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e2748879-ac1c-4f74-9bb0-02569f9756e1 tempest-GroupsTest-1886650315 None] Created volume successfully.
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-ecfd73e7-57f5-443c-ac7c-b68948c2f662" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Deleting offline snapshot ecfd73e7-57f5-443c-ac7c-b68948c2f662 of volume 7f00cf58-6a1d-49a7-9ad2-09c849f5f66e {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] snapshot_file for this snap is: volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e65073-6f24-4780-a050-911a79a59e89]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:58 devstack sudo[84826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662
Apr 14 01:20:58 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:58 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662" returned: 0 in 0.567s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:20:58 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[528e84ba-7d01-4997-bfba-1ed02c2c64c7]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:20:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:58 devstack sudo[84834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e
Apr 14 01:20:58 devstack sudo[84834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:58 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f83e5fec-86db-4742-91d8-0b357d306671 tempest-GroupsTest-1886650315 None] Update group completed successfully.
Apr 14 01:20:59 devstack sudo[84834]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e" returned: 0 in 0.577s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:59 devstack sudo[84842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662
Apr 14 01:20:59 devstack sudo[84842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:20:59 devstack sudo[84842]: pam_unix(sudo:session): session closed for user root
Apr 14 01:20:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662" returned: 0 in 0.479s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:20:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:20:59 devstack sudo[84847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662
Apr 14 01:20:59 devstack sudo[84847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:00 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-bf73d73e-cc25-45f0-b0b9-490930574730 tempest-GroupsTest-1886650315 None] Update group completed successfully.
Apr 14 01:21:00 devstack sudo[84847]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e.ecfd73e7-57f5-443c-ac7c-b68948c2f662" returned: 0 in 0.704s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:00 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-ecfd73e7-57f5-443c-ac7c-b68948c2f662" released by "_delete_snapshot" :: held 2.389s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:00 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e" released by "delete_snapshot" :: held 2.408s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:00 devstack cinder-volume[81812]: WARNING cinder.quota [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-366651448 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-366651448, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:21:00 devstack cinder-volume[81812]: WARNING cinder.quota [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-366651448 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-366651448, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:21:00 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Created reservations ['192ced74-d561-4ad0-9ef3-9d2975917838', '3d7c201a-ac84-4d28-851a-5c94d1b8a663', 'b55b7864-08a7-495b-9798-4958621e9222', 'ddf0f289-eab5-47d5-a4d2-6846f76c8d9f'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:00 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] Created reservations ['064d4fbc-dc94-4723-aa0a-c43bed7d8e94', '0037604f-5cfa-4ed7-86eb-8aef314e8c0a', 'b962d1fc-fede-47b4-b21b-3df77497b31c', '1befd694-7ac8-4bb8-b623-8caed4dfc289'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:00 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-019a62e1-0d6c-4f37-a7fa-294ed3d608e3 tempest-GroupSnapshotsTest-1492847795 None] group_snapshot 3568a05f-82e7-4aca-b1d2-1266920e85d7: deleted successfully
Apr 14 01:21:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e" acquired by "delete_volume" :: waited 0.020s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Acquiring lock "cinder-quobyte-5dbb19fb-9b70-43ee-9901-0ca6ae280d00" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:01 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd3fd96-b6dd-4283-b376-2d499aef0eb9]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Lock "cinder-quobyte-5dbb19fb-9b70-43ee-9901-0ca6ae280d00" acquired by "delete_volume" :: waited 0.025s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:01 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5858ffa-4c88-42da-903e-b638c78d05ec]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:01 devstack sudo[84877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e
Apr 14 01:21:01 devstack sudo[84877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:01 devstack sudo[84878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00
Apr 14 01:21:01 devstack sudo[84878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:02 devstack sudo[84877]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e" returned: 0 in 0.614s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:02 devstack sudo[84887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e
Apr 14 01:21:02 devstack sudo[84887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:02 devstack sudo[84878]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00" returned: 0 in 0.653s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:02 devstack sudo[84889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00
Apr 14 01:21:02 devstack sudo[84889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Flow 'volume_create_manager' (f87707b0-060b-4dc5-aa47-6118004ace4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (223632a3-57f7-421e-808f-d2a70a7a9361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (223632a3-57f7-421e-808f-d2a70a7a9361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-470468968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157e306c-0021-4e70-8015-007a209946fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866c8b1f159041a189f56c457d2893a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:03Z,use_quota=True,user_id='c2bab301e62e4f2cb3b6b1c66c8c6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177c4b17-8069-42f5-a8ef-c96e9b3d11cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177c4b17-8069-42f5-a8ef-c96e9b3d11cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3748c51-495c-470c-8851-d4b27347b3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3748c51-495c-470c-8851-d4b27347b3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '157e306c-0021-4e70-8015-007a209946fe', 'volume_name': 'volume-157e306c-0021-4e70-8015-007a209946fe', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f0bb67-820e-4eec-aa54-e5e4e3568de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f0bb67-820e-4eec-aa54-e5e4e3568de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b559394b-4a97-47b5-a30c-c1bae980059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:02 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Volume 157e306c-0021-4e70-8015-007a209946fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-157e306c-0021-4e70-8015-007a209946fe', 'volume_size': 1}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-470468968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157e306c-0021-4e70-8015-007a209946fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866c8b1f159041a189f56c457d2893a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:03Z,use_quota=True,user_id='c2bab301e62e4f2cb3b6b1c66c8c6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Creating volume 157e306c-0021-4e70-8015-007a209946fe {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:21:02 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-157e306c-0021-4e70-8015-007a209946fe 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:02 devstack sudo[84891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-157e306c-0021-4e70-8015-007a209946fe 1073741824
Apr 14 01:21:02 devstack sudo[84891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:02 devstack sudo[84887]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e" returned: 0 in 0.533s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-7f00cf58-6a1d-49a7-9ad2-09c849f5f66e" released by "delete_volume" :: held 1.199s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-91d10953-280b-42d4-956a-648c69784bd6" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-91d10953-280b-42d4-956a-648c69784bd6" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00b2c44-4278-4d56-be90-e2152f8d6ae0]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:03 devstack sudo[84894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6
Apr 14 01:21:03 devstack sudo[84894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:03 devstack sudo[84889]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5dbb19fb-9b70-43ee-9901-0ca6ae280d00" returned: 0 in 0.606s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Lock "cinder-quobyte-5dbb19fb-9b70-43ee-9901-0ca6ae280d00" released by "delete_volume" :: held 1.291s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Acquiring lock "cinder-quobyte-a85f1a3d-2b0d-4153-8043-a275228e8d95" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Lock "cinder-quobyte-a85f1a3d-2b0d-4153-8043-a275228e8d95" acquired by "delete_volume" :: waited 0.015s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de65c33-ed9d-4e81-ae8c-950437740e96]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a85f1a3d-2b0d-4153-8043-a275228e8d95 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:03 devstack sudo[84897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a85f1a3d-2b0d-4153-8043-a275228e8d95
Apr 14 01:21:03 devstack sudo[84897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:03 devstack sudo[84891]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-157e306c-0021-4e70-8015-007a209946fe 1073741824" returned: 0 in 0.766s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:03 devstack sudo[84894]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6" returned: 0 in 0.557s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-157e306c-0021-4e70-8015-007a209946fe {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:03 devstack sudo[84905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6
Apr 14 01:21:03 devstack sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:03 devstack sudo[84906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-157e306c-0021-4e70-8015-007a209946fe
Apr 14 01:21:03 devstack sudo[84906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG oslo_service.periodic_task [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81812) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:03 devstack sudo[84913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:03 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:04 devstack sudo[84906]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-157e306c-0021-4e70-8015-007a209946fe" returned: 0 in 0.522s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b559394b-4a97-47b5-a30c-c1bae980059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-157e306c-0021-4e70-8015-007a209946fe', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca88fa71-1dfd-4e2c-b58e-866dba479f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:04 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Volume volume-157e306c-0021-4e70-8015-007a209946fe (157e306c-0021-4e70-8015-007a209946fe): created successfully
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca88fa71-1dfd-4e2c-b58e-866dba479f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Flow 'volume_create_manager' (f87707b0-060b-4dc5-aa47-6118004ace4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:04 devstack sudo[84897]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:04 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ac094839-eaf2-4c3a-98c5-a94616721be9 tempest-VolumesActionsTest-1132576215 None] Created volume successfully.
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a85f1a3d-2b0d-4153-8043-a275228e8d95" returned: 0 in 1.029s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a85f1a3d-2b0d-4153-8043-a275228e8d95 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:04 devstack sudo[84916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a85f1a3d-2b0d-4153-8043-a275228e8d95
Apr 14 01:21:04 devstack sudo[84916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:04 devstack sudo[84905]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91d10953-280b-42d4-956a-648c69784bd6" returned: 0 in 0.817s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-91d10953-280b-42d4-956a-648c69784bd6" released by "delete_volume" :: held 1.406s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Created reservations ['ffc40036-8ccb-4490-a69e-84bf27c42d3c'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:04 devstack cinder-volume[81812]: WARNING cinder.quota [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-366651448 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-366651448, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Created reservations ['5eca1b04-7cf2-4a70-954a-5c1a883db5fd', '0232359b-070c-4a85-9291-6d0cd3f79c74', '0f120edc-ff21-407a-9ea1-5e86b11c672c', '90c862fb-9346-41eb-8165-934040c78345'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Created reservations ['e9ce0df4-f6b2-4106-ab56-29b324f2202c', '7237216c-c107-404c-837a-ab91ee99c804', '0fff9e93-f179-4dcc-9821-ddaf6ee40907', 'd8b02327-8ca3-4602-a7b3-98a44c70127b'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:04 devstack sudo[84938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:04 devstack sudo[84938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-67a81a3a-c41a-4803-ab4d-4104a603e8c0 tempest-VolumesActionsTest-1132576215 None] Acquiring lock "cinder-157e306c-0021-4e70-8015-007a209946fe" by "attach_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-67a81a3a-c41a-4803-ab4d-4104a603e8c0 tempest-VolumesActionsTest-1132576215 None] Lock "cinder-157e306c-0021-4e70-8015-007a209946fe" acquired by "attach_volume" :: waited 0.037s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:05 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 1.109s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:05 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-67a81a3a-c41a-4803-ab4d-4104a603e8c0 tempest-VolumesActionsTest-1132576215 None] Attaching volume 157e306c-0021-4e70-8015-007a209946fe to instance fcf4c5ca-14b0-41b1-90df-fef4ae53b8c9 at mountpoint /dev/vdb on host None.
Apr 14 01:21:05 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-67a81a3a-c41a-4803-ab4d-4104a603e8c0 tempest-VolumesActionsTest-1132576215 None] Attach volume completed successfully.
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-67a81a3a-c41a-4803-ab4d-4104a603e8c0 tempest-VolumesActionsTest-1132576215 None] Lock "cinder-157e306c-0021-4e70-8015-007a209946fe" released by "attach_volume" :: held 0.317s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:05 devstack sudo[84916]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a85f1a3d-2b0d-4153-8043-a275228e8d95" returned: 0 in 1.333s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Lock "cinder-quobyte-a85f1a3d-2b0d-4153-8043-a275228e8d95" released by "delete_volume" :: held 2.389s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Created reservations ['2e3b5921-e3d7-4467-ad92-2a551942d97a'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:05 devstack cinder-volume[81812]: WARNING cinder.quota [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1908588845 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1908588845, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:21:05 devstack cinder-volume[81812]: WARNING cinder.quota [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1908588845 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1908588845, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Created reservations ['b7580d16-ce9d-4f29-bb21-b25e677a9cac', '69751e07-c895-48d8-9dd0-bddc70372b22', '4840c3eb-18e9-4244-8fff-78c4635263d2', 'e259372c-272f-4fc3-815d-3137c7cdb45c'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Created reservations ['e732d7c6-cddf-4e0e-9676-2a5de310e934', 'dc86525d-0e48-4c1c-9888-7c0f33b76087', '5f4bdbaf-fa5b-45d5-a3b2-1a52a707cdb1', '6563a504-7efa-4b86-8df7-c4de52bb5006'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:05 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5995d1df-29c2-4eb2-a518-9bd7b53b1bda tempest-GroupSnapshotsTest-1492847795 None] Group tempest-GroupSnapshotsTest-Group-1157798569: creating
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:06 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5995d1df-29c2-4eb2-a518-9bd7b53b1bda tempest-GroupSnapshotsTest-1492847795 None] Group tempest-GroupSnapshotsTest-Group-1157798569: created successfully
Apr 14 01:21:06 devstack sudo[84946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:06 devstack sudo[84946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:06 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5995d1df-29c2-4eb2-a518-9bd7b53b1bda tempest-GroupSnapshotsTest-1492847795 None] Create group completed successfully.
Apr 14 01:21:06 devstack sudo[84938]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 1.189s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:06 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:06 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d1c1729e-7188-44ae-9c2a-0df6e17cc053 tempest-GroupSnapshotsTest-1492847795 None] Delete group completed successfully.
Apr 14 01:21:06 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-610e141b-d990-4812-aba1-23095baf1c88 tempest-VolumesActionsTest-1456153528 None] Terminate volume connection completed successfully.
Apr 14 01:21:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-610e141b-d990-4812-aba1-23095baf1c88 tempest-VolumesActionsTest-1456153528 None] Acquiring lock "cinder-157e306c-0021-4e70-8015-007a209946fe-detach_volume" by "detach_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-610e141b-d990-4812-aba1-23095baf1c88 tempest-VolumesActionsTest-1456153528 None] Lock "cinder-157e306c-0021-4e70-8015-007a209946fe-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:06 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-610e141b-d990-4812-aba1-23095baf1c88 tempest-VolumesActionsTest-1456153528 None] Detaching volume 157e306c-0021-4e70-8015-007a209946fe from instance fcf4c5ca-14b0-41b1-90df-fef4ae53b8c9.
Apr 14 01:21:06 devstack sudo[84946]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.829s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:06 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:06 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2663eb03-c862-4415-b058-63e26f594936 tempest-GroupsTest-1886650315 None] Delete group completed successfully.
Apr 14 01:21:06 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-610e141b-d990-4812-aba1-23095baf1c88 tempest-VolumesActionsTest-1456153528 None] Detach volume completed successfully.
Apr 14 01:21:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-610e141b-d990-4812-aba1-23095baf1c88 tempest-VolumesActionsTest-1456153528 None] Lock "cinder-157e306c-0021-4e70-8015-007a209946fe-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Flow 'volume_create_manager' (c98adebe-d136-44a4-8a1d-23e41abab0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd76ca9-6e4b-462a-a602-ac25db66f368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd76ca9-6e4b-462a-a602-ac25db66f368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1107524737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb159214-7603-417c-a30b-d139188a5e56,host='devstack@QuobyteHD#QuobyteHD',id=d4043703-b851-4f27-b53b-0ec42983ad36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5a307c12d4f329a67db378a34d3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:07Z,use_quota=True,user_id='a7db5d3e77744913ab5660515123e0b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fed02a0-5164-4549-a54a-0787393d1b3f),volume_type_id=3fed02a0-5164-4549-a54a-0787393d1b3f)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d5a579-4313-430f-a9ce-c63331a40fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d5a579-4313-430f-a9ce-c63331a40fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef54d0a-6912-4aa7-bebc-86c0749f4750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef54d0a-6912-4aa7-bebc-86c0749f4750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4043703-b851-4f27-b53b-0ec42983ad36', 'volume_name': 'volume-d4043703-b851-4f27-b53b-0ec42983ad36', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f563d2-c33f-46d5-9c89-90126a04d0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f563d2-c33f-46d5-9c89-90126a04d0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b7afc99-7002-4454-8665-6e1f47405ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:07 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Volume d4043703-b851-4f27-b53b-0ec42983ad36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4043703-b851-4f27-b53b-0ec42983ad36', 'volume_size': 1}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eb159214-7603-417c-a30b-d139188a5e56,created_at=2026-04-13T23:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1107524737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb159214-7603-417c-a30b-d139188a5e56,host='devstack@QuobyteHD#QuobyteHD',id=d4043703-b851-4f27-b53b-0ec42983ad36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5a307c12d4f329a67db378a34d3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:07Z,use_quota=True,user_id='a7db5d3e77744913ab5660515123e0b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fed02a0-5164-4549-a54a-0787393d1b3f),volume_type_id=3fed02a0-5164-4549-a54a-0787393d1b3f)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Creating volume d4043703-b851-4f27-b53b-0ec42983ad36 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:21:07 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-98228a86-0d11-4182-b294-e5c11ad05a6e tempest-VolumesActionsTest-1132576215 None] Acquiring lock "cinder-157e306c-0021-4e70-8015-007a209946fe-detach_volume" by "detach_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-98228a86-0d11-4182-b294-e5c11ad05a6e tempest-VolumesActionsTest-1132576215 None] Lock "cinder-157e306c-0021-4e70-8015-007a209946fe-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:07 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-98228a86-0d11-4182-b294-e5c11ad05a6e tempest-VolumesActionsTest-1132576215 None] Volume detach called, but volume not attached.
Apr 14 01:21:07 devstack sudo[84963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36 1073741824
Apr 14 01:21:07 devstack sudo[84963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-98228a86-0d11-4182-b294-e5c11ad05a6e tempest-VolumesActionsTest-1132576215 None] Lock "cinder-157e306c-0021-4e70-8015-007a209946fe-detach_volume" released by "detach_volume" :: held 0.021s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Acquiring lock "cinder-157e306c-0021-4e70-8015-007a209946fe-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Lock "cinder-157e306c-0021-4e70-8015-007a209946fe-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Acquiring lock "cinder-quobyte-157e306c-0021-4e70-8015-007a209946fe" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Lock "cinder-quobyte-157e306c-0021-4e70-8015-007a209946fe" acquired by "delete_volume" :: waited 0.015s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:08 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bda0573-7d1f-4f57-b058-a0fed44adb5a]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-157e306c-0021-4e70-8015-007a209946fe {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:08 devstack sudo[84963]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36 1073741824" returned: 0 in 0.784s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:08 devstack sudo[84969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36
Apr 14 01:21:08 devstack sudo[84969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:08 devstack sudo[84968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-157e306c-0021-4e70-8015-007a209946fe
Apr 14 01:21:08 devstack sudo[84968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:08 devstack sudo[84969]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36" returned: 0 in 0.713s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:21:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:08 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b7afc99-7002-4454-8665-6e1f47405ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4043703-b851-4f27-b53b-0ec42983ad36', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35157209-5063-47fb-8639-599170588fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:09 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Volume volume-d4043703-b851-4f27-b53b-0ec42983ad36 (d4043703-b851-4f27-b53b-0ec42983ad36): created successfully
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35157209-5063-47fb-8639-599170588fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Flow 'volume_create_manager' (c98adebe-d136-44a4-8a1d-23e41abab0d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:09 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b6799c0c-b791-4fe5-ad79-c881661aff5f tempest-GroupSnapshotsTest-1492847795 None] Created volume successfully.
Apr 14 01:21:09 devstack sudo[84968]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-157e306c-0021-4e70-8015-007a209946fe" returned: 0 in 0.814s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-157e306c-0021-4e70-8015-007a209946fe {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:09 devstack sudo[84976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-157e306c-0021-4e70-8015-007a209946fe
Apr 14 01:21:09 devstack sudo[84976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:09 devstack sudo[84976]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-157e306c-0021-4e70-8015-007a209946fe" returned: 0 in 0.529s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Lock "cinder-quobyte-157e306c-0021-4e70-8015-007a209946fe" released by "delete_volume" :: held 1.370s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Created reservations ['7d587621-595e-4819-84bd-f89b69dfe75d', '8cfca5b4-3106-4ab5-83a5-2248c1bcb601', 'f9839347-11a7-41e2-8d97-ef1f3c4b3c4b', '7c265f05-8c67-4320-aa48-74e0911db5ea'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:09 devstack sudo[84982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:09 devstack sudo[84982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:09 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] GroupSnapshot c3ad0442-889d-4889-ac52-ef0e798c96a9: creating.
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] Group snapshot c3ad0442-889d-4889-ac52-ef0e798c96a9: creating. {{(pid=81812) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] Creating offline snapshot 02a33722-611b-4720-8783-b60688c402f1 of volume d4043703-b851-4f27-b53b-0ec42983ad36 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b525bcdd-0b78-4d71-80bb-b91f575577a3]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:09 devstack sudo[84984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36
Apr 14 01:21:09 devstack sudo[84984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:10 devstack sudo[84982]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.720s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:10 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:10 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Deleted volume successfully.
Apr 14 01:21:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8ec0bd0e-04b6-4473-8ba1-4e7e08be4a3a tempest-VolumesActionsTest-1132576215 None] Lock "cinder-157e306c-0021-4e70-8015-007a209946fe-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:10 devstack sudo[84984]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36" returned: 0 in 0.757s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:10 devstack sudo[84990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1 1G
Apr 14 01:21:10 devstack sudo[84990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:11 devstack sudo[84990]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1 1G" returned: 0 in 0.719s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4043703-b851-4f27-b53b-0ec42983ad36 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:11 devstack sudo[85020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4043703-b851-4f27-b53b-0ec42983ad36 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1
Apr 14 01:21:11 devstack sudo[85020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:12 devstack sudo[85020]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4043703-b851-4f27-b53b-0ec42983ad36 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1" returned: 0 in 1.016s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:12 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1 is being set with open permissions: ugo+rw: NotImplementedError
Apr 14 01:21:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:12 devstack sudo[85058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1
Apr 14 01:21:12 devstack sudo[85058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:13 devstack sudo[85058]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1" returned: 0 in 0.685s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:13 devstack sudo[85082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.info
Apr 14 01:21:13 devstack sudo[85082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:13 devstack sudo[85082]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.info" returned: 0 in 0.686s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:13 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 14 01:21:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:13 devstack sudo[85086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.info
Apr 14 01:21:13 devstack sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:14 devstack sudo[85086]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.info" returned: 0 in 0.599s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.534s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:14 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f3e37dc7-21af-4d0b-8954-faf528d3ee6f tempest-GroupSnapshotsTest-1492847795 None] group_snapshot c3ad0442-889d-4889-ac52-ef0e798c96a9: created successfully
Apr 14 01:21:15 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] group_snapshot c3ad0442-889d-4889-ac52-ef0e798c96a9: deleting
Apr 14 01:21:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] group_snapshot c3ad0442-889d-4889-ac52-ef0e798c96a9: deleting {{(pid=81812) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 14 01:21:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-d4043703-b851-4f27-b53b-0ec42983ad36" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-d4043703-b851-4f27-b53b-0ec42983ad36" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-02a33722-611b-4720-8783-b60688c402f1" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-02a33722-611b-4720-8783-b60688c402f1" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Deleting offline snapshot 02a33722-611b-4720-8783-b60688c402f1 of volume d4043703-b851-4f27-b53b-0ec42983ad36 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:21:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] snapshot_file for this snap is: volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:21:15 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6abcbc3-51a4-4bdc-868e-7f9f3a82f774]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:15 devstack sudo[85089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1
Apr 14 01:21:15 devstack sudo[85089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:15 devstack sudo[85089]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1" returned: 0 in 0.509s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4043703-b851-4f27-b53b-0ec42983ad36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:21:15 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab392cce-28bb-41b4-9fca-deb451c7767e]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:15 devstack sudo[85094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36
Apr 14 01:21:15 devstack sudo[85094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:16 devstack sudo[85094]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36" returned: 0 in 0.552s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:16 devstack sudo[85099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1
Apr 14 01:21:16 devstack sudo[85099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:17 devstack sudo[85099]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1" returned: 0 in 0.591s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:17 devstack sudo[85104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1
Apr 14 01:21:17 devstack sudo[85104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Flow 'volume_create_manager' (23f65f63-1206-4085-ad4b-661d09bd7bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8e3f8b-967c-439c-af38-21433fa37dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8e3f8b-967c-439c-af38-21433fa37dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-638944669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b50255-da6b-4ffc-bcba-af7a2e17cdef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866c8b1f159041a189f56c457d2893a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:17Z,use_quota=True,user_id='c2bab301e62e4f2cb3b6b1c66c8c6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9c947d-f9c4-49ca-9abf-49dc2f874fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9c947d-f9c4-49ca-9abf-49dc2f874fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b4f9cb-dc31-4987-bb21-d44b2e220e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b4f9cb-dc31-4987-bb21-d44b2e220e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9b50255-da6b-4ffc-bcba-af7a2e17cdef', 'volume_name': 'volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafb1ffd-b305-46f0-9abb-e71296df000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafb1ffd-b305-46f0-9abb-e71296df000f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82edac86-e9e5-4230-b74a-a87c3157c340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:17 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Volume d9b50255-da6b-4ffc-bcba-af7a2e17cdef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef', 'volume_size': 1}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-638944669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b50255-da6b-4ffc-bcba-af7a2e17cdef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866c8b1f159041a189f56c457d2893a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:17Z,use_quota=True,user_id='c2bab301e62e4f2cb3b6b1c66c8c6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Creating volume d9b50255-da6b-4ffc-bcba-af7a2e17cdef {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:21:17 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:17 devstack sudo[85107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef 1073741824
Apr 14 01:21:17 devstack sudo[85107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:17 devstack sudo[85104]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36.02a33722-611b-4720-8783-b60688c402f1" returned: 0 in 0.582s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-02a33722-611b-4720-8783-b60688c402f1" released by "_delete_snapshot" :: held 2.292s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-d4043703-b851-4f27-b53b-0ec42983ad36" released by "delete_snapshot" :: held 2.305s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:17 devstack cinder-volume[81812]: WARNING cinder.quota [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1977926402 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1977926402, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:21:17 devstack cinder-volume[81812]: WARNING cinder.quota [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1977926402 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1977926402, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] Created reservations ['eebbcd86-b9eb-4196-a2c1-280994c1c58e', '338989f2-6b74-4b0c-9c2f-b5e50bf81828', '6e48d690-a865-444e-81bc-6bf98c5664b7', 'a80e1df5-8c04-4a98-ae1f-c0b19a36e1b6'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:17 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c27200d8-2b6b-4fc4-b572-89f96c815d26 tempest-GroupSnapshotsTest-1492847795 None] group_snapshot c3ad0442-889d-4889-ac52-ef0e798c96a9: deleted successfully
Apr 14 01:21:17 devstack sudo[85107]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef 1073741824" returned: 0 in 0.627s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:17 devstack sudo[85121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef
Apr 14 01:21:17 devstack sudo[85121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:18 devstack sudo[85121]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef" returned: 0 in 0.588s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:21:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:18 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82edac86-e9e5-4230-b74a-a87c3157c340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:18 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0202d0-d705-4739-962d-34490de5dad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:18 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Volume volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef (d9b50255-da6b-4ffc-bcba-af7a2e17cdef): created successfully
Apr 14 01:21:18 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0202d0-d705-4739-962d-34490de5dad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:18 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Flow 'volume_create_manager' (23f65f63-1206-4085-ad4b-661d09bd7bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:18 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b2288695-73ba-4d9f-a0f3-2fdaf17db48a tempest-VolumesActionsTest-1132576215 None] Created volume successfully.
Apr 14 01:21:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "cinder-quobyte-d4043703-b851-4f27-b53b-0ec42983ad36" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-d4043703-b851-4f27-b53b-0ec42983ad36" acquired by "delete_volume" :: waited 0.021s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:18 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[502068b7-05f4-4de8-9903-4519345a743c]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:18 devstack sudo[85141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36
Apr 14 01:21:18 devstack sudo[85141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Acquiring lock "cinder-d9b50255-da6b-4ffc-bcba-af7a2e17cdef-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Lock "cinder-d9b50255-da6b-4ffc-bcba-af7a2e17cdef-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:19 devstack sudo[85141]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Acquiring lock "cinder-quobyte-d9b50255-da6b-4ffc-bcba-af7a2e17cdef" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36" returned: 0 in 0.796s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Lock "cinder-quobyte-d9b50255-da6b-4ffc-bcba-af7a2e17cdef" acquired by "delete_volume" :: waited 0.020s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:19 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[22959328-6d32-4e48-9748-52ef1d0ce695]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:19 devstack sudo[85146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36
Apr 14 01:21:19 devstack sudo[85146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:19 devstack sudo[85148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef
Apr 14 01:21:19 devstack sudo[85148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Flow 'volume_create_manager' (f5170e30-bc24-4a43-8243-a619d1382864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab509116-96e1-40d6-854c-aa67163e10b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab509116-96e1-40d6-854c-aa67163e10b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2004838359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba80f1f-0daa-450d-8f8b-e2fddfb44ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fdc0907106452fbb99e08d97e2fa75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:20Z,use_quota=True,user_id='6024e5264d6a4ba6b3102ec02c96cc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b290909-9ec1-4413-a5e4-c2b8a3227e8b),volume_type_id=4b290909-9ec1-4413-a5e4-c2b8a3227e8b)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3fff63-9090-4e41-8c1f-000df8d03202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3fff63-9090-4e41-8c1f-000df8d03202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eebfee2-de83-4cd4-adff-1d75305e3967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eebfee2-de83-4cd4-adff-1d75305e3967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cba80f1f-0daa-450d-8f8b-e2fddfb44ceb', 'volume_name': 'volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552ea32c-dafa-4480-8b7d-75d3e9f6aa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552ea32c-dafa-4480-8b7d-75d3e9f6aa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1373ba6c-24c2-479a-872f-a02bcca1e146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:20 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Volume cba80f1f-0daa-450d-8f8b-e2fddfb44ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb', 'volume_size': 1}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2004838359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba80f1f-0daa-450d-8f8b-e2fddfb44ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fdc0907106452fbb99e08d97e2fa75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:20Z,use_quota=True,user_id='6024e5264d6a4ba6b3102ec02c96cc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b290909-9ec1-4413-a5e4-c2b8a3227e8b),volume_type_id=4b290909-9ec1-4413-a5e4-c2b8a3227e8b)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Creating volume cba80f1f-0daa-450d-8f8b-e2fddfb44ceb {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:21:20 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:20 devstack sudo[85151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb 1073741824
Apr 14 01:21:20 devstack sudo[85151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:20 devstack sudo[85146]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d4043703-b851-4f27-b53b-0ec42983ad36" returned: 0 in 0.808s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Lock "cinder-quobyte-d4043703-b851-4f27-b53b-0ec42983ad36" released by "delete_volume" :: held 1.661s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:20 devstack sudo[85148]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef" returned: 0 in 0.865s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Created reservations ['c0a8ce2d-9098-4c10-be80-38cbc0be6fc4'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:20 devstack cinder-volume[81812]: WARNING cinder.quota [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1977926402 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1977926402, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:21:20 devstack sudo[85156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef
Apr 14 01:21:20 devstack sudo[85156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Created reservations ['fc4e5f83-1d95-4b60-808f-317fbaf68dc2', 'f904a5e6-497d-4883-bbc7-e16d8f951759', 'ae64d0c4-fdc9-46cc-b603-4bde61b152f3', 'd4e6ea3c-0a84-4211-b66b-b7dfbf955583'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:20 devstack sudo[85158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:20 devstack sudo[85158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:21 devstack sudo[85151]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb 1073741824" returned: 0 in 0.758s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:21 devstack sudo[85164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb
Apr 14 01:21:21 devstack sudo[85164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:21 devstack sudo[85158]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.487s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:21 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:21 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9c39a5bd-1ea0-45be-baef-160fbaae7fa6 tempest-GroupSnapshotsTest-1492847795 None] Delete group completed successfully.
Apr 14 01:21:21 devstack sudo[85156]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d9b50255-da6b-4ffc-bcba-af7a2e17cdef" returned: 0 in 0.834s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Lock "cinder-quobyte-d9b50255-da6b-4ffc-bcba-af7a2e17cdef" released by "delete_volume" :: held 1.746s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:21 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Created reservations ['36f3a1c6-67d4-44e2-b057-700bb5d7680e', '44372b30-4818-4e20-bd7c-1ddfabfd5bd9', '38407ea0-ef99-4e29-8a64-59566325abd0', '2052c2da-2c22-45c6-9d7e-330161f98c7e'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:21 devstack sudo[85167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:21 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:21 devstack sudo[85164]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb" returned: 0 in 0.793s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1373ba6c-24c2-479a-872f-a02bcca1e146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd055148-943f-4a5c-a137-dacbde2369c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:22 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Volume volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb (cba80f1f-0daa-450d-8f8b-e2fddfb44ceb): created successfully
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd055148-943f-4a5c-a137-dacbde2369c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Flow 'volume_create_manager' (f5170e30-bc24-4a43-8243-a619d1382864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:22 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-cc611807-09e2-4abf-8ee9-33b13143567b tempest-VolumeTypesAccessTest-1672038790 None] Created volume successfully.
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Flow 'volume_create_manager' (21596b44-b1c6-407c-8c95-b75277ccc6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406e59e7-f78c-4af2-a56e-7505910fc386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:22 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.723s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406e59e7-f78c-4af2-a56e-7505910fc386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2020812216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24a51a4-f2b2-4d45-aff0-f95e59db3bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866c8b1f159041a189f56c457d2893a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:22Z,use_quota=True,user_id='c2bab301e62e4f2cb3b6b1c66c8c6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddce950-a105-42ef-af45-6a6d57402758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddce950-a105-42ef-af45-6a6d57402758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e422eec2-1f4b-4e32-b407-2770127a2a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e422eec2-1f4b-4e32-b407-2770127a2a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24a51a4-f2b2-4d45-aff0-f95e59db3bc6', 'volume_name': 'volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4e9aaa-f887-4a7d-a397-c7ee865b484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4e9aaa-f887-4a7d-a397-c7ee865b484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1261675-de4a-49e7-891f-77a4110f3306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:22 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Volume c24a51a4-f2b2-4d45-aff0-f95e59db3bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6', 'volume_size': 1}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2020812216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24a51a4-f2b2-4d45-aff0-f95e59db3bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866c8b1f159041a189f56c457d2893a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:22Z,use_quota=True,user_id='c2bab301e62e4f2cb3b6b1c66c8c6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Creating volume c24a51a4-f2b2-4d45-aff0-f95e59db3bc6 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:21:22 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:22 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Deleted volume successfully.
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f1c03fc4-3e48-4e9b-b672-7fe0bb2dae3f tempest-VolumesActionsTest-1456153528 None] Lock "cinder-d9b50255-da6b-4ffc-bcba-af7a2e17cdef-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:22 devstack sudo[85171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6 1073741824
Apr 14 01:21:22 devstack sudo[85171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Acquiring lock "cinder-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Lock "cinder-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Acquiring lock "cinder-quobyte-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Lock "cinder-quobyte-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb" acquired by "delete_volume" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca1916b-da85-474c-a448-10b84977190c]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:22 devstack sudo[85173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb
Apr 14 01:21:22 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:23 devstack sudo[85171]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6 1073741824" returned: 0 in 0.828s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:23 devstack sudo[85183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6
Apr 14 01:21:23 devstack sudo[85183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:23 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb" returned: 0 in 0.742s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:23 devstack sudo[85186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb
Apr 14 01:21:23 devstack sudo[85186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:23 devstack sudo[85183]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6" returned: 0 in 0.679s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:23 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:21:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1261675-de4a-49e7-891f-77a4110f3306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f852c06d-7e3c-4d4a-b736-eb67e8ed1a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:23 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Volume volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6 (c24a51a4-f2b2-4d45-aff0-f95e59db3bc6): created successfully
Apr 14 01:21:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f852c06d-7e3c-4d4a-b736-eb67e8ed1a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Flow 'volume_create_manager' (21596b44-b1c6-407c-8c95-b75277ccc6c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:23 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c1be8c94-df66-49f0-92b5-a3e199e7be00 tempest-VolumesActionsTest-1132576215 None] Created volume successfully.
Apr 14 01:21:23 devstack sudo[85186]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb" returned: 0 in 0.576s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:23 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Lock "cinder-quobyte-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb" released by "delete_volume" :: held 1.368s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:23 devstack cinder-volume[81812]: WARNING cinder.quota [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1996840823 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1996840823, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:21:23 devstack cinder-volume[81812]: WARNING cinder.quota [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1996840823 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1996840823, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:21:23 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Created reservations ['8d27d6b4-3f50-49b5-9bf8-d834118beb4f', '88cdc56d-dbaa-4b73-80f1-1477686d2588', 'e65e4377-e81a-4ce8-92c1-56cf93890910', '2265279a-9c23-4e05-bb70-1cff50a102bd'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:24 devstack sudo[85190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:24 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Acquiring lock "cinder-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Lock "cinder-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Acquiring lock "cinder-quobyte-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Lock "cinder-quobyte-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a0a685-b224-4142-8044-7ced50dd9732]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:24 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.606s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:24 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Deleted volume successfully.
Apr 14 01:21:24 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6a74dfe2-063c-40af-a5ae-2f7cf1d8ad5d tempest-VolumeTypesAccessTest-1672038790 None] Lock "cinder-cba80f1f-0daa-450d-8f8b-e2fddfb44ceb-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:24 devstack sudo[85193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6
Apr 14 01:21:24 devstack sudo[85193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:25 devstack sudo[85193]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6" returned: 0 in 0.622s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:25 devstack sudo[85198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6
Apr 14 01:21:25 devstack sudo[85198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:25 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b4e64a70-3a3f-4ed3-bd23-542ddc03f916 tempest-GroupsV320Test-2101858004 None] Group tempest-GroupsV320Test-Group-629067686: creating
Apr 14 01:21:25 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b4e64a70-3a3f-4ed3-bd23-542ddc03f916 tempest-GroupsV320Test-2101858004 None] Group tempest-GroupsV320Test-Group-629067686: created successfully
Apr 14 01:21:25 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b4e64a70-3a3f-4ed3-bd23-542ddc03f916 tempest-GroupsV320Test-2101858004 None] Create group completed successfully.
Apr 14 01:21:25 devstack sudo[85198]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6" returned: 0 in 0.595s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:25 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Lock "cinder-quobyte-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6" released by "delete_volume" :: held 1.248s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:25 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Created reservations ['ece1d075-52f7-4419-b1d1-93ce3ea23281', 'dcbf075c-a5ce-4b8d-bd07-87bcf38c0e5f', '935435f5-9cd0-4242-9211-4389ad2a9d61', '02d46555-51a1-4422-a269-a5bf27898a25'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:25 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:25 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:25 devstack sudo[85201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:25 devstack sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:26 devstack sudo[85201]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.615s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:26 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:26 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Deleted volume successfully.
Apr 14 01:21:26 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fca47ec8-f6c4-438a-9215-c7829ecf1107 tempest-VolumesActionsTest-1456153528 None] Lock "cinder-c24a51a4-f2b2-4d45-aff0-f95e59db3bc6-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Flow 'volume_create_manager' (ac71465a-13c0-4780-8daf-14301d537bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113f28a5-42cf-4d10-802d-243fac898d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113f28a5-42cf-4d10-802d-243fac898d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-866125290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77690a5-4833-4a80-9643-84a4ca6fbff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866c8b1f159041a189f56c457d2893a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:27Z,use_quota=True,user_id='c2bab301e62e4f2cb3b6b1c66c8c6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86cf6a88-7dd9-4ff5-976e-95acf9f3e653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86cf6a88-7dd9-4ff5-976e-95acf9f3e653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5daaaafa-ba3a-4d28-b78c-6d10732da300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5daaaafa-ba3a-4d28-b78c-6d10732da300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd77690a5-4833-4a80-9643-84a4ca6fbff0', 'volume_name': 'volume-d77690a5-4833-4a80-9643-84a4ca6fbff0', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c0c3b9-5950-4c8a-bdd4-8047983fae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c0c3b9-5950-4c8a-bdd4-8047983fae1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2ad6f6-3773-44c3-99b6-bf84b29c34c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:27 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Volume d77690a5-4833-4a80-9643-84a4ca6fbff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d77690a5-4833-4a80-9643-84a4ca6fbff0', 'volume_size': 1}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-866125290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77690a5-4833-4a80-9643-84a4ca6fbff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866c8b1f159041a189f56c457d2893a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:27Z,use_quota=True,user_id='c2bab301e62e4f2cb3b6b1c66c8c6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Creating volume d77690a5-4833-4a80-9643-84a4ca6fbff0 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:21:27 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d77690a5-4833-4a80-9643-84a4ca6fbff0 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-1cf8ecc6-da4b-4cb7-b9a2-2946a9273ca8 tempest-GroupsV320Test-2101858004 None] Created reservations ['5de30fe7-12db-4fbd-825a-d852ac7b4acd'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:27 devstack sudo[85204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d77690a5-4833-4a80-9643-84a4ca6fbff0 1073741824
Apr 14 01:21:27 devstack sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1cf8ecc6-da4b-4cb7-b9a2-2946a9273ca8 tempest-GroupsV320Test-2101858004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1cf8ecc6-da4b-4cb7-b9a2-2946a9273ca8 tempest-GroupsV320Test-2101858004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1cf8ecc6-da4b-4cb7-b9a2-2946a9273ca8 tempest-GroupsV320Test-2101858004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1cf8ecc6-da4b-4cb7-b9a2-2946a9273ca8 tempest-GroupsV320Test-2101858004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1cf8ecc6-da4b-4cb7-b9a2-2946a9273ca8 tempest-GroupsV320Test-2101858004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1cf8ecc6-da4b-4cb7-b9a2-2946a9273ca8 tempest-GroupsV320Test-2101858004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:27 devstack sudo[85207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:27 devstack sudo[85207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:27 devstack sudo[85207]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1cf8ecc6-da4b-4cb7-b9a2-2946a9273ca8 tempest-GroupsV320Test-2101858004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.658s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-1cf8ecc6-da4b-4cb7-b9a2-2946a9273ca8 tempest-GroupsV320Test-2101858004 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:27 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-1cf8ecc6-da4b-4cb7-b9a2-2946a9273ca8 tempest-GroupsV320Test-2101858004 None] Delete group completed successfully.
Apr 14 01:21:27 devstack sudo[85204]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d77690a5-4833-4a80-9643-84a4ca6fbff0 1073741824" returned: 0 in 0.769s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d77690a5-4833-4a80-9643-84a4ca6fbff0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:28 devstack sudo[85213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d77690a5-4833-4a80-9643-84a4ca6fbff0
Apr 14 01:21:28 devstack sudo[85213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:28 devstack sudo[85213]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d77690a5-4833-4a80-9643-84a4ca6fbff0" returned: 0 in 0.607s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:28 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:21:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:28 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2ad6f6-3773-44c3-99b6-bf84b29c34c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77690a5-4833-4a80-9643-84a4ca6fbff0', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:28 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d934acd-9f00-4287-b0a5-59c5f8229cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:28 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Volume volume-d77690a5-4833-4a80-9643-84a4ca6fbff0 (d77690a5-4833-4a80-9643-84a4ca6fbff0): created successfully
Apr 14 01:21:28 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d934acd-9f00-4287-b0a5-59c5f8229cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:28 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Flow 'volume_create_manager' (ac71465a-13c0-4780-8daf-14301d537bdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:28 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-34943ee5-bbc4-4c6a-964f-9679948f4d2a tempest-VolumesActionsTest-1132576215 None] Created volume successfully.
Apr 14 01:21:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Acquiring lock "cinder-d77690a5-4833-4a80-9643-84a4ca6fbff0-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Lock "cinder-d77690a5-4833-4a80-9643-84a4ca6fbff0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Acquiring lock "cinder-quobyte-d77690a5-4833-4a80-9643-84a4ca6fbff0" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Lock "cinder-quobyte-d77690a5-4833-4a80-9643-84a4ca6fbff0" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:29 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfab348a-2990-48a6-a289-6d25f17f1ffb]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d77690a5-4833-4a80-9643-84a4ca6fbff0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:29 devstack sudo[85216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d77690a5-4833-4a80-9643-84a4ca6fbff0
Apr 14 01:21:29 devstack sudo[85216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:30 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:21:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Flow 'volume_create_manager' (c3828aa9-8e2f-4e15-89c3-44bc7c808e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3be9320-0942-41e1-9fe8-013f05fc42d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3be9320-0942-41e1-9fe8-013f05fc42d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:30Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b849843f-2840-49e0-82e8-bc179583300a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c8dd93da784eb3b1f6b4a2885e2fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:30Z,use_quota=True,user_id='59155bbee3ed4a8484994bfaa5375f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44457b3b-25e4-4784-81fc-b751f659dbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44457b3b-25e4-4784-81fc-b751f659dbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3d0073-cc91-4786-a9bf-325092b2f94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:30 devstack cinder-volume[81812]: DEBUG cinder.image.glance [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Creating Keystone auth plugin from conf {{(pid=81812) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 14 01:21:30 devstack sudo[85216]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d77690a5-4833-4a80-9643-84a4ca6fbff0" returned: 0 in 1.116s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d77690a5-4833-4a80-9643-84a4ca6fbff0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3d0073-cc91-4786-a9bf-325092b2f94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b849843f-2840-49e0-82e8-bc179583300a', 'volume_name': 'volume-b849843f-2840-49e0-82e8-bc179583300a', 'volume_size': 1, 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '632509b247064588826fa463262eaec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'created_at': datetime.datetime(2026, 4, 13, 23, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 23, 14, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f70df510c10>}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:31 devstack sudo[85224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d77690a5-4833-4a80-9643-84a4ca6fbff0
Apr 14 01:21:31 devstack sudo[85224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbba14c-d4d2-4852-8944-dbbc4968152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbba14c-d4d2-4852-8944-dbbc4968152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1a6af4-b4e1-408d-b4a3-757ea44c9ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:31 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Volume b849843f-2840-49e0-82e8-bc179583300a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b849843f-2840-49e0-82e8-bc179583300a', 'volume_size': 1, 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '632509b247064588826fa463262eaec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'created_at': datetime.datetime(2026, 4, 13, 23, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 23, 14, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f70df510c10>}
Apr 14 01:21:31 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Trying to clone b849843f-2840-49e0-82e8-bc179583300a from image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c at location (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]). {{(pid=81812) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 14 01:21:31 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_laoahiovdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81812) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 14 01:21:31 devstack cinder-volume[81812]: INFO cinder.image.image_utils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Image download 20.69 MB at 20.69 MB/s
Apr 14 01:21:31 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bce5ec-c105-4ada-a7af-b3999fceb868]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_laoahiovdevstack@QuobyteHD {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:31 devstack sudo[85247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_laoahiovdevstack@QuobyteHD
Apr 14 01:21:31 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:31 devstack sudo[85224]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d77690a5-4833-4a80-9643-84a4ca6fbff0" returned: 0 in 0.904s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Lock "cinder-quobyte-d77690a5-4833-4a80-9643-84a4ca6fbff0" released by "delete_volume" :: held 2.102s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:31 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Created reservations ['55488c24-2c69-4b41-8b69-9b3dfb748d3e', '6ddea47f-781a-45d2-99ee-7c897887ef44', '0afe9b59-2fb7-4d6d-a9d3-2d73a8bc88a7', 'c2ef068a-e0ed-4aa4-8c7f-6ae54ad7261c'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:32 devstack sudo[85253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:32 devstack sudo[85253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:32 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_laoahiovdevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:32 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Temporary image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c is fetched for user 59155bbee3ed4a8484994bfaa5375f8a. {{(pid=81812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 14 01:21:32 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[830a085e-95a5-494c-ae1e-21a2760dd9e1]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_laoahiovdevstack@QuobyteHD {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:32 devstack sudo[85255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_laoahiovdevstack@QuobyteHD
Apr 14 01:21:32 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:32 devstack sudo[85253]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.787s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:32 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:32 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Deleted volume successfully.
Apr 14 01:21:32 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-880238c5-115d-40a9-868a-b73dcf468280 tempest-VolumesActionsTest-1456153528 None] Lock "cinder-d77690a5-4833-4a80-9643-84a4ca6fbff0-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:33 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_laoahiovdevstack@QuobyteHD" returned: 0 in 0.986s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:30Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b849843f-2840-49e0-82e8-bc179583300a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c8dd93da784eb3b1f6b4a2885e2fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:30Z,use_quota=True,user_id='59155bbee3ed4a8484994bfaa5375f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Creating volume b849843f-2840-49e0-82e8-bc179583300a {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:21:33 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:33 devstack sudo[85262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a 1073741824
Apr 14 01:21:33 devstack sudo[85262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Flow 'volume_create_manager' (d35ecfb4-7b25-4d5d-b7eb-c833b5022c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5b942f-e249-41bf-bb90-ef537c820251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5b942f-e249-41bf-bb90-ef537c820251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1968653859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866c8b1f159041a189f56c457d2893a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:34Z,use_quota=True,user_id='c2bab301e62e4f2cb3b6b1c66c8c6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6514ce4-ccd1-4b66-9a1e-c19fd116f0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6514ce4-ccd1-4b66-9a1e-c19fd116f0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d677db84-59e3-45e4-b667-c18e5a6ec341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d677db84-59e3-45e4-b667-c18e5a6ec341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866', 'volume_name': 'volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3743a1a9-a2e0-432e-8b17-1f3cd6258735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3743a1a9-a2e0-432e-8b17-1f3cd6258735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7175e4-e862-4083-be46-a3a7b7222da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:33 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Volume 5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866', 'volume_size': 1}
Apr 14 01:21:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:34 devstack sudo[85262]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a 1073741824" returned: 0 in 0.731s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:34 devstack sudo[85270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a
Apr 14 01:21:34 devstack sudo[85270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Flow 'volume_create_manager' (6e341acd-5bc6-45ea-b55b-65d39994b16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b59bf5-957c-4a00-a716-49399c7200fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b59bf5-957c-4a00-a716-49399c7200fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1382714488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125c9d25-e424-43c7-aac3-9afbbb0c0d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82eb916b4aa94919af1f1cf7ff883d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:35Z,use_quota=True,user_id='0a0f5bc6c9294093aa71bf62b86dc2c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d23f5d-1bef-458f-9372-ae285b90ad9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d23f5d-1bef-458f-9372-ae285b90ad9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afc8fce-b825-45aa-9a36-9938f1bd1be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afc8fce-b825-45aa-9a36-9938f1bd1be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '125c9d25-e424-43c7-aac3-9afbbb0c0d23', 'volume_name': 'volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0754253-947c-42a0-b01d-4cd0ef03307b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0754253-947c-42a0-b01d-4cd0ef03307b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db17e20-0431-47c7-b5c2-92520104416f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:34 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Volume 125c9d25-e424-43c7-aac3-9afbbb0c0d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23', 'volume_size': 1}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:34 devstack sudo[85270]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a" returned: 0 in 0.710s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.050s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1968653859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866c8b1f159041a189f56c457d2893a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:34Z,use_quota=True,user_id='c2bab301e62e4f2cb3b6b1c66c8c6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Creating volume 5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:21:34 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG cinder.volume.volume_utils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Attempting download of e868e97b-1f2a-4ab6-b767-6d5c40d5e10c ((None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}])) to volume b849843f-2840-49e0-82e8-bc179583300a. {{(pid=81812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 14 01:21:34 devstack sudo[85287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866 1073741824
Apr 14 01:21:34 devstack sudo[85287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c2e097-1f9a-4c20-896d-4fbebf011284]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kmuc_mzi {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:35 devstack sudo[85289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kmuc_mzi
Apr 14 01:21:35 devstack sudo[85289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:35 devstack sudo[85289]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kmuc_mzi" returned: 0 in 0.650s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kmuc_mzi {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:35 devstack sudo[85287]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866 1073741824" returned: 0 in 0.778s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:35 devstack sudo[85299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kmuc_mzi
Apr 14 01:21:35 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:35 devstack sudo[85300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866
Apr 14 01:21:35 devstack sudo[85300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:36 devstack sudo[85300]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:36 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866" returned: 0 in 0.605s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.537s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1382714488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125c9d25-e424-43c7-aac3-9afbbb0c0d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82eb916b4aa94919af1f1cf7ff883d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:35Z,use_quota=True,user_id='0a0f5bc6c9294093aa71bf62b86dc2c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Creating volume 125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:21:36 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kmuc_mzi" returned: 1 in 0.719s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kmuc_mzi' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5967cf-9886-41a6-85d5-28dd1ecb2e45]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:36 devstack sudo[85306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23 1073741824
Apr 14 01:21:36 devstack sudo[85306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7175e4-e862-4083-be46-a3a7b7222da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0db3bd-ce63-44bf-a74f-55f15de5acf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_laoahiovdevstack@QuobyteHD {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:36 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Volume volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866 (5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866): created successfully
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0db3bd-ce63-44bf-a74f-55f15de5acf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Flow 'volume_create_manager' (d35ecfb4-7b25-4d5d-b7eb-c833b5022c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:36 devstack sudo[85308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_laoahiovdevstack@QuobyteHD
Apr 14 01:21:36 devstack sudo[85308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:36 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2fe06979-6c1c-4e49-9db4-0fd8f084bfb8 tempest-VolumesActionsTest-1132576215 None] Created volume successfully.
Apr 14 01:21:36 devstack sudo[85308]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_laoahiovdevstack@QuobyteHD" returned: 0 in 0.583s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] e868e97b-1f2a-4ab6-b767-6d5c40d5e10c was qcow2, converting to raw {{(pid=81812) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_laoahiovdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:36 devstack sudo[85306]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23 1073741824" returned: 0 in 0.673s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:36 devstack sudo[85316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_laoahiovdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a
Apr 14 01:21:36 devstack sudo[85316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:37 devstack sudo[85318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23
Apr 14 01:21:37 devstack sudo[85318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Acquiring lock "cinder-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Lock "cinder-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Flow 'volume_create_manager' (bf2be9a0-a558-42ef-be7c-2dc2921baaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd173f73-821e-4b1b-b5ff-a4b3d08bed8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Acquiring lock "cinder-quobyte-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd173f73-821e-4b1b-b5ff-a4b3d08bed8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-682208429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b086ab-f80e-479d-98ea-2e944553cb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0afaed540da46efb1cf3be2ab3a5e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:37Z,use_quota=True,user_id='d86cb0c3db5f4da998ab6a6d7c759b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4def9c-35b4-41e0-b116-e25267610d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4def9c-35b4-41e0-b116-e25267610d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f4b084-0922-46de-9cc3-6da3e52698d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f4b084-0922-46de-9cc3-6da3e52698d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00b086ab-f80e-479d-98ea-2e944553cb88', 'volume_name': 'volume-00b086ab-f80e-479d-98ea-2e944553cb88', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7ccb84-a1f4-4b4f-b8b6-9d4f852ba948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7ccb84-a1f4-4b4f-b8b6-9d4f852ba948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378e46ea-cd15-42c7-b429-53b94426a603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:37 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Volume 00b086ab-f80e-479d-98ea-2e944553cb88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00b086ab-f80e-479d-98ea-2e944553cb88', 'volume_size': 1}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Lock "cinder-quobyte-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866" acquired by "delete_volume" :: waited 0.044s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f16be0-c101-466a-9184-401ce2645a2a]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:37 devstack sudo[85321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866
Apr 14 01:21:37 devstack sudo[85321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:37 devstack sudo[85318]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23" returned: 0 in 0.774s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.455s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-682208429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b086ab-f80e-479d-98ea-2e944553cb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0afaed540da46efb1cf3be2ab3a5e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:37Z,use_quota=True,user_id='d86cb0c3db5f4da998ab6a6d7c759b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Creating volume 00b086ab-f80e-479d-98ea-2e944553cb88 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:21:37 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00b086ab-f80e-479d-98ea-2e944553cb88 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db17e20-0431-47c7-b5c2-92520104416f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc97f611-22d6-4b4e-96b1-c3270b57bd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:37 devstack sudo[85329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00b086ab-f80e-479d-98ea-2e944553cb88 1073741824
Apr 14 01:21:37 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:37 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Volume volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23 (125c9d25-e424-43c7-aac3-9afbbb0c0d23): created successfully
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc97f611-22d6-4b4e-96b1-c3270b57bd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Flow 'volume_create_manager' (6e341acd-5bc6-45ea-b55b-65d39994b16a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:37 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2f4d7b2d-546b-44a1-b70f-04726796c466 tempest-SnapshotsActionsTest-1973021730 None] Created volume successfully.
Apr 14 01:21:37 devstack sudo[85316]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_laoahiovdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a" returned: 0 in 1.101s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_laoahiovdevstack@QuobyteHD, size 112.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:21:37 devstack cinder-volume[81812]: INFO cinder.image.image_utils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Converted 112.00 MB image at 101.68 MB/s
Apr 14 01:21:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:38 devstack sudo[85334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a 1G
Apr 14 01:21:38 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:38 devstack sudo[85321]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866" returned: 0 in 0.724s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:38 devstack sudo[85336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866
Apr 14 01:21:38 devstack sudo[85336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:38 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00b086ab-f80e-479d-98ea-2e944553cb88 1073741824" returned: 0 in 0.580s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00b086ab-f80e-479d-98ea-2e944553cb88 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:38 devstack sudo[85341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00b086ab-f80e-479d-98ea-2e944553cb88
Apr 14 01:21:38 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:38 devstack sudo[85336]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866" returned: 0 in 0.568s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Lock "cinder-quobyte-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866" released by "delete_volume" :: held 1.318s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Created reservations ['6f48cd42-c77c-4b87-ac53-a45910968aac', '8fcd8cf8-8585-4c60-a60a-e43052c48747', '8df53931-1250-4193-a8e8-57519792a07b', '9d77c386-45ed-405b-b086-f29c035112af'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:38 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a 1G" returned: 0 in 0.713s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d576eb2c-0276-4697-8909-ea7ffd6d6f0e]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:38 devstack sudo[85347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:38 devstack sudo[85347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:38 devstack sudo[85348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a
Apr 14 01:21:38 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:38 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00b086ab-f80e-479d-98ea-2e944553cb88" returned: 0 in 0.493s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378e46ea-cd15-42c7-b429-53b94426a603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b086ab-f80e-479d-98ea-2e944553cb88', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed5b2a2-a14b-4f8a-b2c4-0a727da92b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:38 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Volume volume-00b086ab-f80e-479d-98ea-2e944553cb88 (00b086ab-f80e-479d-98ea-2e944553cb88): created successfully
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed5b2a2-a14b-4f8a-b2c4-0a727da92b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Flow 'volume_create_manager' (bf2be9a0-a558-42ef-be7c-2dc2921baaab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:38 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b5ed618c-35e4-43bb-8783-e1de50b826ef tempest-VolumesListAdminTestJSON-1548769079 None] Created volume successfully.
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] Creating offline snapshot 3bc6e60e-b310-4496-bf27-a8423a2dcecf of volume 125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d16fdf-ea17-4326-b69c-e842191ab5ab]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:39 devstack sudo[85347]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.488s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:39 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Deleted volume successfully.
Apr 14 01:21:39 devstack sudo[85353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23
Apr 14 01:21:39 devstack sudo[85353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-341b17ce-e916-4c54-af86-7acaf6e80080 tempest-VolumesActionsTest-1456153528 None] Lock "cinder-5fe4d6a7-8ac3-44fc-8aaf-e617aebf6866-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:39 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a" returned: 0 in 0.672s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:39 devstack sudo[85357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a
Apr 14 01:21:39 devstack sudo[85357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Flow 'volume_create_manager' (ef01034f-6cac-4df8-9b5d-a92546cbf77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577ccbf7-c319-42fa-8ed0-82e7badfc419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Flow 'volume_create_manager' (1ccd2aa9-bba3-4aee-96c8-e55b3a27519a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b4eb38-aab7-4336-92cf-2a4983b99ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577ccbf7-c319-42fa-8ed0-82e7badfc419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1555373467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a516587-18cd-4b11-947e-770a93e84f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866c8b1f159041a189f56c457d2893a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:40Z,use_quota=True,user_id='c2bab301e62e4f2cb3b6b1c66c8c6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30029ea-5689-424f-948c-a23f1b02d06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30029ea-5689-424f-948c-a23f1b02d06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c724d740-a382-4dfc-8421-e54544dff64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c724d740-a382-4dfc-8421-e54544dff64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a516587-18cd-4b11-947e-770a93e84f1c', 'volume_name': 'volume-3a516587-18cd-4b11-947e-770a93e84f1c', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e63425d-cfde-4ffc-8733-3c7bb6156a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e63425d-cfde-4ffc-8733-3c7bb6156a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f2aede-ab5b-4ff5-af41-530ab4c81b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:39 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Volume 3a516587-18cd-4b11-947e-770a93e84f1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a516587-18cd-4b11-947e-770a93e84f1c', 'volume_size': 1}
Apr 14 01:21:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b4eb38-aab7-4336-92cf-2a4983b99ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1587341452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd969e16-2b25-4bbd-8d8d-405b6b5cb626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0afaed540da46efb1cf3be2ab3a5e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:40Z,use_quota=True,user_id='d86cb0c3db5f4da998ab6a6d7c759b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abda8bd5-8a09-4e80-8607-aa3fadfd23af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abda8bd5-8a09-4e80-8607-aa3fadfd23af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8942e5-65be-4984-8332-cddb60ee2eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8942e5-65be-4984-8332-cddb60ee2eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd969e16-2b25-4bbd-8d8d-405b6b5cb626', 'volume_name': 'volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76ee432-eb25-47a5-af56-6a6336a6df19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76ee432-eb25-47a5-af56-6a6336a6df19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bc47d7-799a-4167-96b8-099edb28292a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:40 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Volume fd969e16-2b25-4bbd-8d8d-405b6b5cb626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626', 'volume_size': 1}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:40 devstack sudo[85353]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23" returned: 0 in 0.900s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:40 devstack sudo[85363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf 1G
Apr 14 01:21:40 devstack sudo[85363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:40 devstack sudo[85357]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a" returned: 1 in 0.770s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.volume_utils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Downloaded image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c ((None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}])) to volume b849843f-2840-49e0-82e8-bc179583300a successfully. {{(pid=81812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Temporary image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c for user 59155bbee3ed4a8484994bfaa5375f8a is deleted. {{(pid=81812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.volume_utils [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Marking volume b849843f-2840-49e0-82e8-bc179583300a as bootable. {{(pid=81812) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Copying metadata from image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c to b849843f-2840-49e0-82e8-bc179583300a. {{(pid=81812) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Creating volume glance metadata for volume b849843f-2840-49e0-82e8-bc179583300a backed by image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81812) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1a6af4-b4e1-408d-b4a3-757ea44c9ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b849843f-2840-49e0-82e8-bc179583300a', 'volume_size': 1, 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '632509b247064588826fa463262eaec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'created_at': datetime.datetime(2026, 4, 13, 23, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 23, 14, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f70df510c10>}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c0a076-22d6-4954-b861-974e99937f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:40 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Volume volume-b849843f-2840-49e0-82e8-bc179583300a (b849843f-2840-49e0-82e8-bc179583300a): created successfully
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c0a076-22d6-4954-b861-974e99937f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Flow 'volume_create_manager' (c3828aa9-8e2f-4e15-89c3-44bc7c808e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:40 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-41b6bf24-897b-4f81-b1ce-2751edcb5bae tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Created volume successfully.
Apr 14 01:21:40 devstack sudo[85363]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf 1G" returned: 0 in 0.524s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:40 devstack sudo[85372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf
Apr 14 01:21:40 devstack sudo[85372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:41 devstack sudo[85372]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf" returned: 0 in 0.491s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:41 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf is being set with open permissions: ugo+rw
Apr 14 01:21:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:41 devstack sudo[85377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf
Apr 14 01:21:41 devstack sudo[85377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:41 devstack sudo[85377]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf" returned: 0 in 0.443s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:41 devstack sudo[85380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.info
Apr 14 01:21:41 devstack sudo[85380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:41 devstack sudo[85380]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.info" returned: 0 in 0.432s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:41 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.info is being set with open permissions: ugo+rw
Apr 14 01:21:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:41 devstack sudo[85383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.info
Apr 14 01:21:41 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:42 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.info" returned: 0 in 0.451s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.304s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.416s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1555373467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a516587-18cd-4b11-947e-770a93e84f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866c8b1f159041a189f56c457d2893a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:40Z,use_quota=True,user_id='c2bab301e62e4f2cb3b6b1c66c8c6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:21:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Creating volume 3a516587-18cd-4b11-947e-770a93e84f1c {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:21:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:21:42 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:21:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3a516587-18cd-4b11-947e-770a93e84f1c 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:42 devstack sudo[85386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3a516587-18cd-4b11-947e-770a93e84f1c 1073741824
Apr 14 01:21:42 devstack sudo[85386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:42 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:SELECT=190,cinder:UPDATE=201,cinder:INSERT=53,cinder:DELETE=9 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:21:42 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f3fef2da-868b-403c-b912-d4bd59f25ab3 tempest-SnapshotsActionsTest-1973021730 None] Create snapshot completed successfully
Apr 14 01:21:42 devstack sudo[85386]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3a516587-18cd-4b11-947e-770a93e84f1c 1073741824" returned: 0 in 0.556s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3a516587-18cd-4b11-947e-770a93e84f1c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:43 devstack sudo[85399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3a516587-18cd-4b11-947e-770a93e84f1c
Apr 14 01:21:43 devstack sudo[85399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-9d5f536f-c36f-47e5-9963-253ae262f5bc tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:43 devstack sudo[85399]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3a516587-18cd-4b11-947e-770a93e84f1c" returned: 0 in 0.458s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.448s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1587341452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd969e16-2b25-4bbd-8d8d-405b6b5cb626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0afaed540da46efb1cf3be2ab3a5e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:40Z,use_quota=True,user_id='d86cb0c3db5f4da998ab6a6d7c759b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Creating volume fd969e16-2b25-4bbd-8d8d-405b6b5cb626 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:21:43 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f2aede-ab5b-4ff5-af41-530ab4c81b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a516587-18cd-4b11-947e-770a93e84f1c', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:43 devstack sudo[85402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626 1073741824
Apr 14 01:21:43 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be145b67-6077-4acd-bbc3-2c36518418a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:43 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Volume volume-3a516587-18cd-4b11-947e-770a93e84f1c (3a516587-18cd-4b11-947e-770a93e84f1c): created successfully
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be145b67-6077-4acd-bbc3-2c36518418a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Flow 'volume_create_manager' (ef01034f-6cac-4df8-9b5d-a92546cbf77d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:SELECT=174,cinder:UPDATE=181,cinder:DELETE=11,cinder:INSERT=46 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:21:43 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-fcfae291-63dd-4fda-ab53-1fbc26f4013b tempest-VolumesActionsTest-1132576215 None] Created volume successfully.
Apr 14 01:21:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:44 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626 1073741824" returned: 0 in 0.582s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:44 devstack sudo[85407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626
Apr 14 01:21:44 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:44 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626" returned: 0 in 0.461s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-9d5f536f-c36f-47e5-9963-253ae262f5bc tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.468s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bc47d7-799a-4167-96b8-099edb28292a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e84543-1cf2-4041-bc7c-0df7325c933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0a5532-0b78-4f31-b99c-ac5d508acd1e]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-9d5f536f-c36f-47e5-9963-253ae262f5bc tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:44 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Volume volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626 (fd969e16-2b25-4bbd-8d8d-405b6b5cb626): created successfully
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e84543-1cf2-4041-bc7c-0df7325c933f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Flow 'volume_create_manager' (1ccd2aa9-bba3-4aee-96c8-e55b3a27519a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Acquiring lock "cinder-3a516587-18cd-4b11-947e-770a93e84f1c-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:44 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-4a21f0a9-89fa-4cad-a89e-eeade6e282c6 tempest-VolumesListAdminTestJSON-1548769079 None] Created volume successfully.
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Lock "cinder-3a516587-18cd-4b11-947e-770a93e84f1c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Acquiring lock "cinder-quobyte-3a516587-18cd-4b11-947e-770a93e84f1c" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:44 devstack sudo[85410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a
Apr 14 01:21:44 devstack sudo[85410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Lock "cinder-quobyte-3a516587-18cd-4b11-947e-770a93e84f1c" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[21482072-0008-4074-8164-9057ac49f4ef]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3a516587-18cd-4b11-947e-770a93e84f1c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:44 devstack sudo[85412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3a516587-18cd-4b11-947e-770a93e84f1c
Apr 14 01:21:44 devstack sudo[85412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:45 devstack sudo[85410]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-9d5f536f-c36f-47e5-9963-253ae262f5bc tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a" returned: 0 in 0.494s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-9d5f536f-c36f-47e5-9963-253ae262f5bc tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:45 devstack sudo[85416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a
Apr 14 01:21:45 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:45 devstack sudo[85412]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3a516587-18cd-4b11-947e-770a93e84f1c" returned: 0 in 0.546s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3a516587-18cd-4b11-947e-770a93e84f1c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:45 devstack sudo[85421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3a516587-18cd-4b11-947e-770a93e84f1c
Apr 14 01:21:45 devstack sudo[85421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:45 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-9d5f536f-c36f-47e5-9963-253ae262f5bc tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a" returned: 1 in 0.510s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-9d5f536f-c36f-47e5-9963-253ae262f5bc tempest-ServerBootFromVolumeStableRescueTest-358802188 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-e8779575-07a0-4286-94f5-b51d6457655e req-9d5f536f-c36f-47e5-9963-253ae262f5bc tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.040s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.911s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Flow 'volume_create_manager' (65951ee9-0049-4b4b-803d-b7c8f70ad52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038aa829-b1bb-4016-b878-65bcaadb68ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] Creating offline snapshot 06bb78c0-ccb0-48ca-8dcc-2f679d60867a of volume 125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c096d0-8c7f-4d5c-ae5b-486a5b783cd7]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-9d5f536f-c36f-47e5-9963-253ae262f5bc tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45', 'name': 'volume-b849843f-2840-49e0-82e8-bc179583300a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b28d5db3-ebbe-4b77-8238-5433ba3346d1', 'enforce_multipath': True} {{(pid=81812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038aa829-b1bb-4016-b878-65bcaadb68ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-141805672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b27860-fd72-4f9c-8012-ff7cfb2d5788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0afaed540da46efb1cf3be2ab3a5e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:46Z,use_quota=True,user_id='d86cb0c3db5f4da998ab6a6d7c759b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216b566f-9e24-49f5-ba8f-d9f821515d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216b566f-9e24-49f5-ba8f-d9f821515d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51a8590-a3b9-44c0-ba81-00ba02958ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51a8590-a3b9-44c0-ba81-00ba02958ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96b27860-fd72-4f9c-8012-ff7cfb2d5788', 'volume_name': 'volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad641b60-a4b5-479f-b6a2-9ac667055fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad641b60-a4b5-479f-b6a2-9ac667055fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:45 devstack sudo[85421]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c812c2-8752-4d79-8d68-2f119d68912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:45 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Volume 96b27860-fd72-4f9c-8012-ff7cfb2d5788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788', 'volume_size': 1}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3a516587-18cd-4b11-947e-770a93e84f1c" returned: 0 in 0.515s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Lock "cinder-quobyte-3a516587-18cd-4b11-947e-770a93e84f1c" released by "delete_volume" :: held 1.108s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:45 devstack sudo[85427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf
Apr 14 01:21:45 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:45 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-e8779575-07a0-4286-94f5-b51d6457655e req-9d5f536f-c36f-47e5-9963-253ae262f5bc tempest-ServerBootFromVolumeStableRescueTest-358802188 None] attachment_update completed successfully.
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Created reservations ['5ee03165-8aac-4704-ab2c-d3d91951114b', 'a41b4c60-3aa1-409d-8b13-f94bb5b48983', 'fbfe239b-e38b-4e14-b8ef-0d138ebceed4', '57849ca6-74bd-4398-abc5-74b99104f432'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:45 devstack sudo[85429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:45 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:46 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf" returned: 0 in 0.509s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:21:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:46 devstack sudo[85434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a 1G
Apr 14 01:21:46 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:46 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.453s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:46 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:46 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Deleted volume successfully.
Apr 14 01:21:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-dee5d7f9-9d2f-4e47-a7cc-53343366869b tempest-VolumesActionsTest-1132576215 None] Lock "cinder-3a516587-18cd-4b11-947e-770a93e84f1c-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:46 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a 1G" returned: 0 in 0.501s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:46 devstack sudo[85440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a
Apr 14 01:21:46 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:47 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a" returned: 0 in 0.518s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:47 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a is being set with open permissions: ugo+rw
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:47 devstack sudo[85445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a
Apr 14 01:21:47 devstack sudo[85445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:47 devstack sudo[85445]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a" returned: 0 in 0.466s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.979s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-141805672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b27860-fd72-4f9c-8012-ff7cfb2d5788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0afaed540da46efb1cf3be2ab3a5e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:46Z,use_quota=True,user_id='d86cb0c3db5f4da998ab6a6d7c759b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Creating volume 96b27860-fd72-4f9c-8012-ff7cfb2d5788 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:21:47 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:47 devstack sudo[85449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788 1073741824
Apr 14 01:21:47 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:47 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3ee30659-d5a8-4ce0-ab81-89b0c7557b0a tempest-SnapshotsActionsTest-1973021730 None] Create snapshot completed successfully
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Acquiring lock "cinder-06bb78c0-ccb0-48ca-8dcc-2f679d60867a-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-06bb78c0-ccb0-48ca-8dcc-2f679d60867a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Acquiring lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Acquiring lock "cinder-quobyte-06bb78c0-ccb0-48ca-8dcc-2f679d60867a" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-06bb78c0-ccb0-48ca-8dcc-2f679d60867a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Deleting offline snapshot 06bb78c0-ccb0-48ca-8dcc-2f679d60867a of volume 125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] snapshot_file for this snap is: volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[145d5fd6-586b-43fb-91dd-6daa6647cf94]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:48 devstack sudo[85452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a
Apr 14 01:21:48 devstack sudo[85452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:48 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788 1073741824" returned: 0 in 0.548s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:48 devstack sudo[85457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788
Apr 14 01:21:48 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:48 devstack sudo[85452]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a" returned: 0 in 0.571s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac8ef62-da08-44fc-9d57-3d0b9e1df903]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:48 devstack sudo[85462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf
Apr 14 01:21:48 devstack sudo[85462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:48 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788" returned: 0 in 0.578s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c812c2-8752-4d79-8d68-2f119d68912b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e8472d-6ef7-426a-9da7-1dd06b086734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:48 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Volume volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788 (96b27860-fd72-4f9c-8012-ff7cfb2d5788): created successfully
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e8472d-6ef7-426a-9da7-1dd06b086734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Flow 'volume_create_manager' (65951ee9-0049-4b4b-803d-b7c8f70ad52c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:48 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-18dd092a-6e4b-43e2-aae6-5991c02eb29b tempest-VolumesListAdminTestJSON-1548769079 None] Created volume successfully.
Apr 14 01:21:49 devstack sudo[85462]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf" returned: 0 in 0.644s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:21:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:49 devstack sudo[85471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a
Apr 14 01:21:49 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:49 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a" returned: 0 in 0.610s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:49 devstack sudo[85477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a
Apr 14 01:21:49 devstack sudo[85477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Flow 'volume_create_manager' (7be2bd89-b780-4924-96b7-b84b3e00fe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ea3e27-8786-4bf8-a942-2304f37bdb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ea3e27-8786-4bf8-a942-2304f37bdb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5daf5f-b418-4443-a71d-4dd4e225f42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8339054d96d4bfcab7a7cdd10a2d3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:50Z,use_quota=True,user_id='5bfd699289804166ac7ec57c625b4957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9e8bcd-5ed0-4c55-a8d5-ac7d78e6e4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9e8bcd-5ed0-4c55-a8d5-ac7d78e6e4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b267eab7-1ee9-422d-863b-e10da51808af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b267eab7-1ee9-422d-863b-e10da51808af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e5daf5f-b418-4443-a71d-4dd4e225f42f', 'volume_name': 'volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a60e09-b165-49ac-85ea-007a210dee07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a60e09-b165-49ac-85ea-007a210dee07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708b4a72-725b-4fec-9929-b14eeab2f51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:50 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Volume 8e5daf5f-b418-4443-a71d-4dd4e225f42f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f', 'volume_size': 1}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5daf5f-b418-4443-a71d-4dd4e225f42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8339054d96d4bfcab7a7cdd10a2d3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:21:50Z,use_quota=True,user_id='5bfd699289804166ac7ec57c625b4957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Creating volume 8e5daf5f-b418-4443-a71d-4dd4e225f42f {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:21:50 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:50 devstack sudo[85477]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.06bb78c0-ccb0-48ca-8dcc-2f679d60867a" returned: 0 in 0.623s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:50 devstack sudo[85503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f 1073741824
Apr 14 01:21:50 devstack sudo[85503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-06bb78c0-ccb0-48ca-8dcc-2f679d60867a" released by "_delete_snapshot" :: held 2.552s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" released by "delete_snapshot" :: held 2.565s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Created reservations ['36be17b8-4365-491f-82ee-cfa419e5d224', '116313b0-4640-4d99-bda7-d9cf6003662f', '2d8c3f92-dba8-470d-9fb1-fd9b1a0b63f8', '24a02f76-18d4-4aea-85fb-eb6349978510'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:50 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Delete snapshot completed successfully.
Apr 14 01:21:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3884cf1f-f067-4d1c-8227-e34bf31bc876 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-06bb78c0-ccb0-48ca-8dcc-2f679d60867a-delete_snapshot" released by "delete_snapshot" :: held 2.943s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:52 devstack sudo[85503]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f 1073741824" returned: 0 in 1.555s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:52 devstack sudo[85512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f
Apr 14 01:21:52 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:52 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f" returned: 0 in 0.578s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] <== create_volume: return (2166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:21:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.984s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708b4a72-725b-4fec-9929-b14eeab2f51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e250e0f-dfac-47ed-ad90-118b5e2814c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:21:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] Creating offline snapshot d5cececd-85c4-41a7-ad7e-58fd5caf31b0 of volume 125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:21:52 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Volume volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f (8e5daf5f-b418-4443-a71d-4dd4e225f42f): created successfully
Apr 14 01:21:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e250e0f-dfac-47ed-ad90-118b5e2814c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:21:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Flow 'volume_create_manager' (7be2bd89-b780-4924-96b7-b84b3e00fe14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:21:52 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6e4a90-1cea-4021-bc19-21bcec547d67]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:52 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c224ec5a-0333-4a18-a868-e4f001793116 tempest-VolumesListAdminTestJSON-2100809092 None] Created volume successfully.
Apr 14 01:21:53 devstack sudo[85515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf
Apr 14 01:21:53 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:53 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf" returned: 0 in 0.874s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:21:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:53 devstack sudo[85521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0 1G
Apr 14 01:21:53 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:53 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Acquiring lock "cinder-8e5daf5f-b418-4443-a71d-4dd4e225f42f-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:53 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Lock "cinder-8e5daf5f-b418-4443-a71d-4dd4e225f42f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Acquiring lock "cinder-quobyte-8e5daf5f-b418-4443-a71d-4dd4e225f42f" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Lock "cinder-quobyte-8e5daf5f-b418-4443-a71d-4dd4e225f42f" acquired by "delete_volume" :: waited 0.030s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:54 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b96873-51ae-4189-aa35-4d8bf44d64fd]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:54 devstack sudo[85523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f
Apr 14 01:21:54 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "cinder-96b27860-fd72-4f9c-8012-ff7cfb2d5788-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Lock "cinder-96b27860-fd72-4f9c-8012-ff7cfb2d5788-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "cinder-quobyte-96b27860-fd72-4f9c-8012-ff7cfb2d5788" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Lock "cinder-quobyte-96b27860-fd72-4f9c-8012-ff7cfb2d5788" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:54 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1b965a-9760-4b26-b94a-9a8aac1a5e0e]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:54 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0 1G" returned: 0 in 0.855s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:54 devstack sudo[85530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788
Apr 14 01:21:54 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:54 devstack sudo[85531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0
Apr 14 01:21:54 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:55 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0" returned: 0 in 0.659s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:55 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0 is being set with open permissions: ugo+rw
Apr 14 01:21:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:55 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f" returned: 0 in 1.230s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:55 devstack sudo[85544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f
Apr 14 01:21:55 devstack sudo[85544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:55 devstack sudo[85543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0
Apr 14 01:21:55 devstack sudo[85543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:55 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788" returned: 0 in 0.871s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:55 devstack sudo[85547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788
Apr 14 01:21:55 devstack sudo[85547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:56 devstack sudo[85544]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8e5daf5f-b418-4443-a71d-4dd4e225f42f" returned: 0 in 0.712s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Lock "cinder-quobyte-8e5daf5f-b418-4443-a71d-4dd4e225f42f" released by "delete_volume" :: held 1.976s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Created reservations ['94659a06-86c0-4e82-8e04-d18b732bb30a', '0a6b47eb-e024-4ac0-95c7-3b0f586975cc', '29b4db47-65de-4799-91dc-ce4d6890a507', '53f07ec4-c7c5-428a-95ab-6e7743261daf'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:56 devstack sudo[85547]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-96b27860-fd72-4f9c-8012-ff7cfb2d5788" returned: 0 in 0.745s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:56 devstack sudo[85543]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0" returned: 0 in 0.866s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Lock "cinder-quobyte-96b27860-fd72-4f9c-8012-ff7cfb2d5788" released by "delete_volume" :: held 1.670s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.538s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:56 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e6fd06c4-0007-4f1e-ba7f-64dd9e5b740b tempest-SnapshotsActionsTest-1973021730 None] Create snapshot completed successfully
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Created reservations ['35333f90-f007-4e43-9cb3-64a7471f56a1', 'cf4f54f1-77b4-42c9-ae83-12ee27d5aaab', '31273dbd-e5d0-4738-a3e3-42ac6addfa16', '5deef070-1659-4e9f-8637-bdcbc7eed979'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:56 devstack sudo[85552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:56 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:56 devstack sudo[85554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:56 devstack sudo[85554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:56 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.477s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:56 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Deleted volume successfully.
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ba41e910-e92c-43fb-8fd7-f03ad0eaa388 tempest-VolumesListAdminTestJSON-2100809092 None] Lock "cinder-8e5daf5f-b418-4443-a71d-4dd4e225f42f-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "cinder-fd969e16-2b25-4bbd-8d8d-405b6b5cb626-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Lock "cinder-fd969e16-2b25-4bbd-8d8d-405b6b5cb626-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "cinder-quobyte-fd969e16-2b25-4bbd-8d8d-405b6b5cb626" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Lock "cinder-quobyte-fd969e16-2b25-4bbd-8d8d-405b6b5cb626" acquired by "delete_volume" :: waited 0.026s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7dde22-100e-4763-b6a9-dc6407f33daf]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:56 devstack sudo[85554]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.665s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:56 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Deleted volume successfully.
Apr 14 01:21:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d1f1c89e-0027-41cb-b0ca-fed7f6bfecd2 tempest-VolumesListAdminTestJSON-1548769079 None] Lock "cinder-96b27860-fd72-4f9c-8012-ff7cfb2d5788-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:57 devstack sudo[85558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626
Apr 14 01:21:57 devstack sudo[85558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Acquiring lock "cinder-d5cececd-85c4-41a7-ad7e-58fd5caf31b0-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-d5cececd-85c4-41a7-ad7e-58fd5caf31b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Acquiring lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Acquiring lock "cinder-quobyte-d5cececd-85c4-41a7-ad7e-58fd5caf31b0" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-d5cececd-85c4-41a7-ad7e-58fd5caf31b0" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Deleting offline snapshot d5cececd-85c4-41a7-ad7e-58fd5caf31b0 of volume 125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] snapshot_file for this snap is: volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2765f1-b48c-41fc-be87-c7d5f5596068]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:57 devstack sudo[85560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0
Apr 14 01:21:57 devstack sudo[85560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:57 devstack sudo[85558]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626" returned: 0 in 0.696s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:57 devstack sudo[85566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626
Apr 14 01:21:57 devstack sudo[85566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:57 devstack sudo[85560]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0" returned: 0 in 0.628s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[421430ab-c24b-4965-91ff-43579cd2a216]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:57 devstack sudo[85577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf
Apr 14 01:21:57 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:58 devstack sudo[85566]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fd969e16-2b25-4bbd-8d8d-405b6b5cb626" returned: 0 in 0.558s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Lock "cinder-quobyte-fd969e16-2b25-4bbd-8d8d-405b6b5cb626" released by "delete_volume" :: held 1.286s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Created reservations ['81f9ca02-db32-417c-8620-265cc3b19912', 'aea52c89-1721-4b85-bcbc-4fb4ce4a7985', 'c656bb53-c4fa-46fb-aba1-252853574587', '3942338a-74c4-4c19-bd5f-282af442851c'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:58 devstack sudo[85604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:21:58 devstack sudo[85604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:58 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf" returned: 0 in 0.776s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:58 devstack sudo[85615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0
Apr 14 01:21:58 devstack sudo[85615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:58 devstack sudo[85604]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.540s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:21:58 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Deleted volume successfully.
Apr 14 01:21:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7dff2283-d33e-449a-8474-2735faab85be tempest-VolumesListAdminTestJSON-1548769079 None] Lock "cinder-fd969e16-2b25-4bbd-8d8d-405b6b5cb626-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "cinder-00b086ab-f80e-479d-98ea-2e944553cb88-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Lock "cinder-00b086ab-f80e-479d-98ea-2e944553cb88-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "cinder-quobyte-00b086ab-f80e-479d-98ea-2e944553cb88" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Lock "cinder-quobyte-00b086ab-f80e-479d-98ea-2e944553cb88" acquired by "delete_volume" :: waited 0.015s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac32d136-1f31-4f47-83a7-6aff84e275ac]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00b086ab-f80e-479d-98ea-2e944553cb88 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:59 devstack sudo[85622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00b086ab-f80e-479d-98ea-2e944553cb88
Apr 14 01:21:59 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:59 devstack sudo[85615]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0" returned: 0 in 0.721s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:59 devstack sudo[85624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0
Apr 14 01:21:59 devstack sudo[85624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:59 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00b086ab-f80e-479d-98ea-2e944553cb88" returned: 0 in 0.661s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00b086ab-f80e-479d-98ea-2e944553cb88 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:21:59 devstack sudo[85657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00b086ab-f80e-479d-98ea-2e944553cb88
Apr 14 01:21:59 devstack sudo[85657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:21:59 devstack sudo[85624]: pam_unix(sudo:session): session closed for user root
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.d5cececd-85c4-41a7-ad7e-58fd5caf31b0" returned: 0 in 0.531s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-d5cececd-85c4-41a7-ad7e-58fd5caf31b0" released by "_delete_snapshot" :: held 2.708s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" released by "delete_snapshot" :: held 2.720s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Created reservations ['4d6ef201-10a5-4494-a30e-dbfc9b54d0eb', '991fd837-af79-4d11-8883-c3b149135cb8', '725cbf43-9521-4ef8-8ebd-d2243a34749f', 'b957aaf0-2a2e-463a-b0c1-2282ff7abf05'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:21:59 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Delete snapshot completed successfully.
Apr 14 01:21:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7f90257-d376-4a4a-920e-04e0ba05ffd1 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-d5cececd-85c4-41a7-ad7e-58fd5caf31b0-delete_snapshot" released by "delete_snapshot" :: held 2.807s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:00 devstack sudo[85657]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00b086ab-f80e-479d-98ea-2e944553cb88" returned: 0 in 0.518s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Lock "cinder-quobyte-00b086ab-f80e-479d-98ea-2e944553cb88" released by "delete_volume" :: held 1.222s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Created reservations ['e1a81a38-014e-48f1-bc33-b5e3fd64158e', 'c9b88ba6-3901-4305-826a-6041e6f6b35a', '208c286d-e7c5-489b-98ce-fb992d0ffdd3', 'cf9e9888-4bbe-4959-8fa2-b448987cda5b'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:00 devstack sudo[85666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:00 devstack sudo[85666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] Creating offline snapshot 46e0e3b6-ed11-4a7c-8763-f2952f05741a of volume 125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b3a1b4-06cd-44fc-bcad-8dccde066550]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:00 devstack sudo[85668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf
Apr 14 01:22:00 devstack sudo[85668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:00 devstack sudo[85666]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.555s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:00 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Deleted volume successfully.
Apr 14 01:22:00 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f270ae5f-47fd-49d1-b1a4-40687e6a044d tempest-VolumesListAdminTestJSON-1548769079 None] Lock "cinder-00b086ab-f80e-479d-98ea-2e944553cb88-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:01 devstack sudo[85668]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf" returned: 0 in 0.617s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:01 devstack sudo[85674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a 1G
Apr 14 01:22:01 devstack sudo[85674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Flow 'volume_create_manager' (70b95979-fd8d-4101-aa1f-4ba48a148124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57ff127-1e7d-4407-90d8-e72a85dd4f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57ff127-1e7d-4407-90d8-e72a85dd4f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1594099011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3004757f-d7fe-4e57-9b51-2cd590c4a9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a7b2e538dc494487b94ae7361e7bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:01Z,use_quota=True,user_id='b72a073732f149739be329cbc98023a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afac4fe-775d-4047-aba1-b61596c345e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afac4fe-775d-4047-aba1-b61596c345e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7bc60c7-e716-4cf3-a7ec-9e97ffcb6622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7bc60c7-e716-4cf3-a7ec-9e97ffcb6622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3004757f-d7fe-4e57-9b51-2cd590c4a9ae', 'volume_name': 'volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d2f0d3-7a00-486e-b2ec-fd61c5e7dc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d2f0d3-7a00-486e-b2ec-fd61c5e7dc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6d6b0b-3a66-4c62-9e8c-00a5b8e30f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:01 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Volume 3004757f-d7fe-4e57-9b51-2cd590c4a9ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae', 'volume_size': 1}
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:01 devstack sudo[85674]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a 1G" returned: 0 in 0.544s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:01 devstack sudo[85679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a
Apr 14 01:22:01 devstack sudo[85679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:02 devstack sudo[85679]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a" returned: 0 in 0.562s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:02 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a is being set with open permissions: ugo+rw
Apr 14 01:22:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:02 devstack sudo[85684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a
Apr 14 01:22:02 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:02 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a" returned: 0 in 0.471s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.506s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1594099011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3004757f-d7fe-4e57-9b51-2cd590c4a9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a7b2e538dc494487b94ae7361e7bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:01Z,use_quota=True,user_id='b72a073732f149739be329cbc98023a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:22:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Creating volume 3004757f-d7fe-4e57-9b51-2cd590c4a9ae {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:22:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:02 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:22:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:02 devstack sudo[85687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae 1073741824
Apr 14 01:22:02 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:02 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3b60f936-e4a4-448f-83a5-51db9e7d78b2 tempest-SnapshotsActionsTest-1973021730 None] Create snapshot completed successfully
Apr 14 01:22:03 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae 1073741824" returned: 0 in 0.588s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:03 devstack sudo[85692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae
Apr 14 01:22:03 devstack sudo[85692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Acquiring lock "cinder-46e0e3b6-ed11-4a7c-8763-f2952f05741a-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-46e0e3b6-ed11-4a7c-8763-f2952f05741a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Acquiring lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Acquiring lock "cinder-quobyte-46e0e3b6-ed11-4a7c-8763-f2952f05741a" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-46e0e3b6-ed11-4a7c-8763-f2952f05741a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Deleting offline snapshot 46e0e3b6-ed11-4a7c-8763-f2952f05741a of volume 125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] snapshot_file for this snap is: volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92e2ef7-9846-4ed8-9778-026a2c066e3e]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:03 devstack sudo[85695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a
Apr 14 01:22:03 devstack sudo[85695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:03 devstack sudo[85692]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae" returned: 0 in 0.500s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG oslo_service.periodic_task [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81812) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6d6b0b-3a66-4c62-9e8c-00a5b8e30f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:03 devstack sudo[85697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:03 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9187c8ed-bf8a-4774-ad8a-aa5927c320df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:04 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Volume volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae (3004757f-d7fe-4e57-9b51-2cd590c4a9ae): created successfully
Apr 14 01:22:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9187c8ed-bf8a-4774-ad8a-aa5927c320df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Flow 'volume_create_manager' (70b95979-fd8d-4101-aa1f-4ba48a148124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:04 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ffa69c43-982c-4b35-aedf-568672775b2d tempest-VolumesDeleteCascade-1659295260 None] Created volume successfully.
Apr 14 01:22:04 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.583s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:04 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:04 devstack sudo[85695]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a" returned: 0 in 0.739s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:04 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa09bd97-78cf-47f4-ae36-26d4982e7d2a]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:04 devstack sudo[85730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf
Apr 14 01:22:04 devstack sudo[85730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] Creating offline snapshot c9047e4d-17cd-4f89-94de-19707f7ad4a7 of volume 3004757f-d7fe-4e57-9b51-2cd590c4a9ae {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:22:04 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51cefb3-a88c-45e6-a44a-28631b04279d]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:05 devstack sudo[85739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae
Apr 14 01:22:05 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:05 devstack sudo[85730]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf" returned: 0 in 0.948s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:05 devstack sudo[85747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a
Apr 14 01:22:05 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:05 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae" returned: 0 in 0.769s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:05 devstack sudo[85752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 1G
Apr 14 01:22:05 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:06 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a" returned: 0 in 0.733s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:06 devstack sudo[85760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a
Apr 14 01:22:06 devstack sudo[85760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:06 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 1G" returned: 0 in 0.781s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:06 devstack sudo[85762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7
Apr 14 01:22:06 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Flow 'volume_create_manager' (945d67d4-2e97-4c77-8d0f-2be5ddf953ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882ddf04-a2dc-4dac-a0fb-692d4b8eddbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882ddf04-a2dc-4dac-a0fb-692d4b8eddbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1145432846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241567c2-5c9d-4378-ae90-be2b82528a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304f077a601b4daf98bf9450726d42e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:07Z,use_quota=True,user_id='6881ed89b5214e38825005b383bceaf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2934eb56-c026-450f-a68e-d2f9b8291b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2934eb56-c026-450f-a68e-d2f9b8291b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ebde74-d793-407a-891f-269f9bbf7ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ebde74-d793-407a-891f-269f9bbf7ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '241567c2-5c9d-4378-ae90-be2b82528a97', 'volume_name': 'volume-241567c2-5c9d-4378-ae90-be2b82528a97', 'volume_size': 2}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e301e23-f61a-43d9-9ec8-386c9da49a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e301e23-f61a-43d9-9ec8-386c9da49a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c60a131-dbe7-471a-9810-a922e7789f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:06 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Volume 241567c2-5c9d-4378-ae90-be2b82528a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-241567c2-5c9d-4378-ae90-be2b82528a97', 'volume_size': 2}
Apr 14 01:22:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:07 devstack sudo[85760]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.46e0e3b6-ed11-4a7c-8763-f2952f05741a" returned: 0 in 0.714s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-46e0e3b6-ed11-4a7c-8763-f2952f05741a" released by "_delete_snapshot" :: held 3.189s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" released by "delete_snapshot" :: held 3.201s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:07 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Created reservations ['d9b35c5f-691e-4cea-a525-2a785bfdb531', '3a17632d-ee49-44e5-9da3-d346b2823995', 'f192518b-daad-47c3-9d89-a7589720e41a', '6c7c8792-b1f8-4393-bb34-ceffd3945fe3'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:07 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Delete snapshot completed successfully.
Apr 14 01:22:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-eff96a5b-e7bb-424b-8b2b-3cf4634d17b5 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-46e0e3b6-ed11-4a7c-8763-f2952f05741a-delete_snapshot" released by "delete_snapshot" :: held 3.290s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:07 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7" returned: 0 in 0.646s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:07 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 is being set with open permissions: ugo+rw
Apr 14 01:22:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:07 devstack sudo[85768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7
Apr 14 01:22:07 devstack sudo[85768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:07 devstack sudo[85768]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7" returned: 0 in 0.435s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:07 devstack sudo[85772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.info
Apr 14 01:22:07 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:08 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.info" returned: 0 in 0.545s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:08 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.info is being set with open permissions: ugo+rw
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:08 devstack sudo[85775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.info
Apr 14 01:22:08 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:08 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.info" returned: 0 in 0.464s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.765s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.814s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1145432846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241567c2-5c9d-4378-ae90-be2b82528a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304f077a601b4daf98bf9450726d42e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:07Z,use_quota=True,user_id='6881ed89b5214e38825005b383bceaf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Creating volume 241567c2-5c9d-4378-ae90-be2b82528a97 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:08 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:22:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97 2147483648 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:08 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b0388d0d-328c-4151-8532-c63c8d34cfda tempest-VolumesDeleteCascade-1659295260 None] Create snapshot completed successfully
Apr 14 01:22:08 devstack sudo[85778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97 2147483648
Apr 14 01:22:08 devstack sudo[85778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:09 devstack sudo[85778]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97 2147483648" returned: 0 in 0.711s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:09 devstack sudo[85810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97
Apr 14 01:22:09 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:09 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97" returned: 0 in 0.473s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:09 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:22:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.640s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c60a131-dbe7-471a-9810-a922e7789f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241567c2-5c9d-4378-ae90-be2b82528a97', 'volume_size': 2}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa370d74-1417-47c5-99ab-9ac492a8048b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:09 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] Creating offline snapshot e241132c-07d4-4098-bcd1-e887fcf4456d of volume 125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:22:09 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Volume volume-241567c2-5c9d-4378-ae90-be2b82528a97 (241567c2-5c9d-4378-ae90-be2b82528a97): created successfully
Apr 14 01:22:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa370d74-1417-47c5-99ab-9ac492a8048b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Flow 'volume_create_manager' (945d67d4-2e97-4c77-8d0f-2be5ddf953ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:09 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8573542a-e965-474e-93ec-62d227b16054 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Created volume successfully.
Apr 14 01:22:09 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9a34cf-bc86-4377-8a8b-cd98594f85a5]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:10 devstack sudo[85836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf
Apr 14 01:22:10 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:10 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf" returned: 0 in 0.610s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:10 devstack sudo[85842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d 1G
Apr 14 01:22:10 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:11 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d 1G" returned: 0 in 0.689s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:11 devstack sudo[85847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d
Apr 14 01:22:11 devstack sudo[85847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:11 devstack sudo[85847]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d" returned: 0 in 0.515s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:11 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d is being set with open permissions: ugo+rw
Apr 14 01:22:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:11 devstack sudo[85854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d
Apr 14 01:22:11 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:12 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d" returned: 0 in 0.496s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.126s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] Creating offline snapshot 447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c of volume 3004757f-d7fe-4e57-9b51-2cd590c4a9ae {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[377f561d-138d-442c-b19d-ebe166c77a6e]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:12 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5d2a2396-d502-4a0a-a9c2-83d017d17a8b tempest-SnapshotsActionsTest-1973021730 None] Create snapshot completed successfully
Apr 14 01:22:12 devstack sudo[85857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7
Apr 14 01:22:12 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Acquiring lock "cinder-e241132c-07d4-4098-bcd1-e887fcf4456d-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-e241132c-07d4-4098-bcd1-e887fcf4456d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Acquiring lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Acquiring lock "cinder-quobyte-e241132c-07d4-4098-bcd1-e887fcf4456d" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-e241132c-07d4-4098-bcd1-e887fcf4456d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Deleting offline snapshot e241132c-07d4-4098-bcd1-e887fcf4456d of volume 125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] snapshot_file for this snap is: volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3b9d3b-6e47-4eb5-a1b9-1cbc30d0d122]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:12 devstack sudo[85859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d
Apr 14 01:22:12 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:12 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7" returned: 0 in 0.559s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:12 devstack sudo[85896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c 1G
Apr 14 01:22:12 devstack sudo[85896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:13 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d" returned: 0 in 0.546s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:13 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3cbfdb-06e4-4370-888d-004a23b6a2ec]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:13 devstack sudo[85907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf
Apr 14 01:22:13 devstack sudo[85907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:13 devstack sudo[85896]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c 1G" returned: 0 in 0.744s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:13 devstack sudo[85928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c
Apr 14 01:22:13 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:13 devstack sudo[85907]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf" returned: 0 in 0.630s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:13 devstack sudo[85933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d
Apr 14 01:22:13 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:14 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c" returned: 0 in 0.481s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:14 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c is being set with open permissions: ugo+rw
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:14 devstack sudo[85941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c
Apr 14 01:22:14 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:14 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d" returned: 0 in 0.559s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:14 devstack sudo[85947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d
Apr 14 01:22:14 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:14 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c" returned: 0 in 0.517s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.360s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.386s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Creating offline snapshot ed51aa95-99a5-495e-853a-89fef32ea73e of volume 241567c2-5c9d-4378-ae90-be2b82528a97 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:22:14 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-fc0d61f0-c47c-4bf2-9cf4-0382eb0af61a tempest-VolumesDeleteCascade-1659295260 None] Create snapshot completed successfully
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ff6e8a-645a-4a22-aae3-78d7d0d3d254]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:14 devstack sudo[85950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97
Apr 14 01:22:14 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:14 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.e241132c-07d4-4098-bcd1-e887fcf4456d" returned: 0 in 0.559s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-e241132c-07d4-4098-bcd1-e887fcf4456d" released by "_delete_snapshot" :: held 2.346s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" released by "delete_snapshot" :: held 2.358s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Created reservations ['10b6423c-39d9-4c4a-9df2-301e5a5a25de', 'cea5465b-bd30-405e-af14-70c6e507f9ad', '305afce5-51d1-42da-a7f6-9186779da8af', '1e2c5caf-6d8f-4c49-ab95-277dd9e621c7'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:14 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Delete snapshot completed successfully.
Apr 14 01:22:14 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ccfd4585-4b91-4c71-b5de-f25202e60298 tempest-SnapshotsActionsTest-689353503 None] Lock "cinder-e241132c-07d4-4098-bcd1-e887fcf4456d-delete_snapshot" released by "delete_snapshot" :: held 2.436s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:15 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97" returned: 0 in 0.484s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e 2G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:15 devstack sudo[85957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e 2G
Apr 14 01:22:15 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-3004757f-d7fe-4e57-9b51-2cd590c4a9ae-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-3004757f-d7fe-4e57-9b51-2cd590c4a9ae-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Performing cascade delete. {{(pid=81812) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-quobyte-3004757f-d7fe-4e57-9b51-2cd590c4a9ae" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-3004757f-d7fe-4e57-9b51-2cd590c4a9ae" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-quobyte-447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Deleting offline snapshot 447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c of volume 3004757f-d7fe-4e57-9b51-2cd590c4a9ae {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] snapshot_file for this snap is: volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d531e112-c59a-4eff-9a59-e5f4646c77b3]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:15 devstack sudo[85961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c
Apr 14 01:22:15 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:15 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e 2G" returned: 0 in 0.553s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241567c2-5c9d-4378-ae90-be2b82528a97 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:15 devstack sudo[85964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241567c2-5c9d-4378-ae90-be2b82528a97 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e
Apr 14 01:22:15 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:15 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-b57d8966-f96b-4be4-9656-bef60525c957 req-a82c6b32-6e05-4155-8119-900bb47c332a tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Terminate volume connection completed successfully.
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-b57d8966-f96b-4be4-9656-bef60525c957 req-a82c6b32-6e05-4155-8119-900bb47c332a tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Deleting attachment b28d5db3-ebbe-4b77-8238-5433ba3346d1. {{(pid=81812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 14 01:22:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Acquiring lock "cinder-3bc6e60e-b310-4496-bf27-a8423a2dcecf-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Lock "cinder-3bc6e60e-b310-4496-bf27-a8423a2dcecf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Acquiring lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Acquiring lock "cinder-quobyte-3bc6e60e-b310-4496-bf27-a8423a2dcecf" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Lock "cinder-quobyte-3bc6e60e-b310-4496-bf27-a8423a2dcecf" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Deleting offline snapshot 3bc6e60e-b310-4496-bf27-a8423a2dcecf of volume 125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] snapshot_file for this snap is: volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d6db42-2f80-4c98-8635-399c73c9d8e2]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:16 devstack sudo[85966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf
Apr 14 01:22:16 devstack sudo[85966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:16 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c" returned: 0 in 0.596s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6739c00a-47a2-4814-b767-ae894e3e2602]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:16 devstack sudo[85974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7
Apr 14 01:22:16 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:16 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241567c2-5c9d-4378-ae90-be2b82528a97 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e" returned: 0 in 0.524s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:16 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e is being set with open permissions: ugo+rw
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:16 devstack sudo[85976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e
Apr 14 01:22:16 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Acquiring lock "cinder-b849843f-2840-49e0-82e8-bc179583300a-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "cinder-b849843f-2840-49e0-82e8-bc179583300a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Acquiring lock "cinder-quobyte-b849843f-2840-49e0-82e8-bc179583300a" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "cinder-quobyte-b849843f-2840-49e0-82e8-bc179583300a" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12bd1a0-3dc0-4a5c-a17f-45422c257e3e]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:16 devstack sudo[85966]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf" returned: 0 in 0.539s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5776b62c-0daa-49de-9dd0-09329ea383f5]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:16 devstack sudo[85981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a
Apr 14 01:22:16 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:16 devstack sudo[85982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23
Apr 14 01:22:16 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:16 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7" returned: 0 in 0.550s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:16 devstack sudo[85989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c
Apr 14 01:22:16 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:16 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e" returned: 0 in 0.506s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:16 devstack sudo[85991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.info
Apr 14 01:22:16 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:17 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a" returned: 0 in 0.621s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:17 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23" returned: 0 in 0.579s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:17 devstack sudo[86002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf
Apr 14 01:22:17 devstack sudo[86002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:17 devstack sudo[86001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a
Apr 14 01:22:17 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:17 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c" returned: 0 in 0.573s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:17 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.info" returned: 0 in 0.529s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:17 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.info is being set with open permissions: ugo+rw
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:17 devstack sudo[86006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c
Apr 14 01:22:17 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:17 devstack sudo[86008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.info
Apr 14 01:22:17 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:17 devstack sudo[86002]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf" returned: 0 in 0.526s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:17 devstack sudo[86019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf
Apr 14 01:22:17 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:17 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a" returned: 1 in 0.598s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:17 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.info" returned: 0 in 0.433s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.099s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:17 devstack sudo[86021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a
Apr 14 01:22:17 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:17 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-30b43d73-ff06-4730-b744-4932875af82f tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Create snapshot completed successfully
Apr 14 01:22:17 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c" returned: 0 in 0.495s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c" released by "_delete_snapshot" :: held 2.263s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-3004757f-d7fe-4e57-9b51-2cd590c4a9ae" released by "delete_snapshot" :: held 2.273s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Created reservations ['e418cc6e-ba40-4e22-9878-8a9f5982b6d4', '953c545d-12d8-484c-b0d0-b8fe88157365', '3697f366-e4c0-4ea0-9c6b-0151c8be9f83', '84c36356-0a12-42cf-83ef-757d1cbfd7b5'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:17 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Delete snapshot completed successfully.
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-447c5f4e-8ec4-4dc6-a3fc-a2003b8ccb8c-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-c9047e4d-17cd-4f89-94de-19707f7ad4a7-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-c9047e4d-17cd-4f89-94de-19707f7ad4a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-quobyte-3004757f-d7fe-4e57-9b51-2cd590c4a9ae" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-3004757f-d7fe-4e57-9b51-2cd590c4a9ae" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-quobyte-c9047e4d-17cd-4f89-94de-19707f7ad4a7" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-c9047e4d-17cd-4f89-94de-19707f7ad4a7" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Deleting offline snapshot c9047e4d-17cd-4f89-94de-19707f7ad4a7 of volume 3004757f-d7fe-4e57-9b51-2cd590c4a9ae {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] snapshot_file for this snap is: volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf455166-eb46-47b8-ae15-1547ec1cb931]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:17 devstack sudo[86023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7
Apr 14 01:22:17 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:18 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23.3bc6e60e-b310-4496-bf27-a8423a2dcecf" returned: 0 in 0.474s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Lock "cinder-quobyte-3bc6e60e-b310-4496-bf27-a8423a2dcecf" released by "_delete_snapshot" :: held 2.176s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" released by "delete_snapshot" :: held 2.188s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:18 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b849843f-2840-49e0-82e8-bc179583300a" returned: 0 in 0.494s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "cinder-quobyte-b849843f-2840-49e0-82e8-bc179583300a" released by "delete_volume" :: held 1.782s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Created reservations ['ed874c43-3e3c-4418-9b58-b4e19fc0d53a', '0ee31a40-f5dd-456f-a5ec-0139e691c63c', '012dcb7a-39d1-4f24-96ca-9fd1101d932d', 'f922d839-53bf-4756-9704-23685faea93a'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.quota [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Created reservations ['06e7b124-6f0f-4d7a-89fe-aabed16887bf', '971d94ce-6a20-416d-9560-ae2e750575d4', '9276565d-ce17-451e-a13e-4a5a178beb9a', '12b01e2f-e925-4cd1-81ed-5e46abd1689f'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:18 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Delete snapshot completed successfully.
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3c987318-072d-41a2-8d16-cf501ccda9e6 tempest-SnapshotsActionsTest-1973021730 None] Lock "cinder-3bc6e60e-b310-4496-bf27-a8423a2dcecf-delete_snapshot" released by "delete_snapshot" :: held 2.348s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:18 devstack sudo[86027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:18 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:18 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7" returned: 0 in 0.548s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd42d12-d1f5-43fb-85a1-570b2e3bedff]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:18 devstack sudo[86032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae
Apr 14 01:22:18 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Acquiring lock "cinder-ed51aa95-99a5-495e-853a-89fef32ea73e-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "cinder-ed51aa95-99a5-495e-853a-89fef32ea73e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Acquiring lock "cinder-quobyte-241567c2-5c9d-4378-ae90-be2b82528a97" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "cinder-quobyte-241567c2-5c9d-4378-ae90-be2b82528a97" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Acquiring lock "cinder-quobyte-ed51aa95-99a5-495e-853a-89fef32ea73e" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "cinder-quobyte-ed51aa95-99a5-495e-853a-89fef32ea73e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Deleting offline snapshot ed51aa95-99a5-495e-853a-89fef32ea73e of volume 241567c2-5c9d-4378-ae90-be2b82528a97 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] snapshot_file for this snap is: volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f36ce6-00ea-42c1-93cc-ab920d5ec999]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:18 devstack sudo[86034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e
Apr 14 01:22:18 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:18 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.461s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.manager [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:18 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Deleted volume successfully.
Apr 14 01:22:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-b57d8966-f96b-4be4-9656-bef60525c957 req-f979118f-dd37-4cee-a534-93800a5dbb1d tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "cinder-b849843f-2840-49e0-82e8-bc179583300a-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:19 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae" returned: 0 in 0.517s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:19 devstack sudo[86040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7
Apr 14 01:22:19 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:19 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e" returned: 0 in 0.543s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-241567c2-5c9d-4378-ae90-be2b82528a97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e3f67f-8caf-4674-b6d4-2fc016af88d1]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Acquiring lock "cinder-125c9d25-e424-43c7-aac3-9afbbb0c0d23-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Lock "cinder-125c9d25-e424-43c7-aac3-9afbbb0c0d23-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Acquiring lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1116ee98-0b51-40fb-ae56-e4d4fb221102]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:19 devstack sudo[86045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97
Apr 14 01:22:19 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:19 devstack sudo[86046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23
Apr 14 01:22:19 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:19 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7" returned: 0 in 0.518s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:19 devstack sudo[86052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7
Apr 14 01:22:19 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:19 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97" returned: 0 in 0.638s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:19 devstack sudo[86060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e
Apr 14 01:22:19 devstack sudo[86060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:19 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23" returned: 0 in 0.602s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:19 devstack sudo[86062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23
Apr 14 01:22:19 devstack sudo[86062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:20 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae.c9047e4d-17cd-4f89-94de-19707f7ad4a7" returned: 0 in 0.536s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-c9047e4d-17cd-4f89-94de-19707f7ad4a7" released by "_delete_snapshot" :: held 2.168s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-3004757f-d7fe-4e57-9b51-2cd590c4a9ae" released by "delete_snapshot" :: held 2.177s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Created reservations ['2a4f7735-de93-4354-b2d3-61e542de737b', '65711ca4-1c38-4ef5-9e93-a5256906dcda', '5415dfe4-7a55-42ba-9c2c-604f8dfb45b0', '2be1de0d-a2b7-4b71-b1df-93e0e1786f21'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:20 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Delete snapshot completed successfully.
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-c9047e4d-17cd-4f89-94de-19707f7ad4a7-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Snapshots deleted, issuing volume delete {{(pid=81812) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-quobyte-3004757f-d7fe-4e57-9b51-2cd590c4a9ae" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-3004757f-d7fe-4e57-9b51-2cd590c4a9ae" acquired by "delete_volume" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fa523f-e8fe-4102-873a-ff739e483754]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:20 devstack sudo[86065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae
Apr 14 01:22:20 devstack sudo[86065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:20 devstack sudo[86060]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e" returned: 0 in 0.493s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:20 devstack sudo[86071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e
Apr 14 01:22:20 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:20 devstack sudo[86062]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-125c9d25-e424-43c7-aac3-9afbbb0c0d23" returned: 0 in 0.475s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Lock "cinder-quobyte-125c9d25-e424-43c7-aac3-9afbbb0c0d23" released by "delete_volume" :: held 1.106s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Created reservations ['5a44e83e-a270-492e-b960-f5f1adb639fe', '3c6d24e5-962e-4cfc-b681-b4162819559d', '56950739-50c8-4b44-829c-6759542463c6', '051e2be7-87d6-4c7f-8253-95b4a9992767'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:20 devstack sudo[86073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:20 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:20 devstack sudo[86065]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae" returned: 0 in 0.775s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:20 devstack sudo[86104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae
Apr 14 01:22:20 devstack sudo[86104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:20 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97.ed51aa95-99a5-495e-853a-89fef32ea73e" returned: 0 in 0.634s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "cinder-quobyte-ed51aa95-99a5-495e-853a-89fef32ea73e" released by "_delete_snapshot" :: held 2.386s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "cinder-quobyte-241567c2-5c9d-4378-ae90-be2b82528a97" released by "delete_snapshot" :: held 2.399s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Created reservations ['debc4c0a-1e12-4cd3-9475-f471f66b7b60', '9095607e-d974-4e1f-b011-7449c9865c4c', '200e4aaa-f0a0-4232-b5ba-2737b1377360', 'eccd9453-6559-441b-b78d-87c3f9ba2408'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:21 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Delete snapshot completed successfully.
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e5c4587f-f2ed-4676-b697-2f8333d0fca2 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "cinder-ed51aa95-99a5-495e-853a-89fef32ea73e-delete_snapshot" released by "delete_snapshot" :: held 2.500s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:21 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.671s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:21 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Deleted volume successfully.
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0f73b7d7-59cf-4fd3-9070-10b4175c59bd tempest-SnapshotsActionsTest-1973021730 None] Lock "cinder-125c9d25-e424-43c7-aac3-9afbbb0c0d23-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:21 devstack sudo[86104]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3004757f-d7fe-4e57-9b51-2cd590c4a9ae" returned: 0 in 0.486s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-3004757f-d7fe-4e57-9b51-2cd590c4a9ae" released by "delete_volume" :: held 1.295s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Created reservations ['37ac9696-834a-4bc6-8459-42891de3441e', '7b2e1f35-8f66-4c1b-a0ad-083178ca4c0f', 'db97790f-ac32-4078-86f7-3d8611ceb706', 'e95d99b8-89b1-4ef6-be85-03a1bb7fa716'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:21 devstack sudo[86109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:21 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Acquiring lock "cinder-241567c2-5c9d-4378-ae90-be2b82528a97-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "cinder-241567c2-5c9d-4378-ae90-be2b82528a97-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Acquiring lock "cinder-quobyte-241567c2-5c9d-4378-ae90-be2b82528a97" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "cinder-quobyte-241567c2-5c9d-4378-ae90-be2b82528a97" acquired by "delete_volume" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc38384f-0562-489d-9909-3dc052278c54]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:22 devstack sudo[86111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97
Apr 14 01:22:22 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:22 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.684s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:22 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Deleted volume successfully.
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5516ba3b-7a00-40bf-b620-dafb42b0420c tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-3004757f-d7fe-4e57-9b51-2cd590c4a9ae-delete_volume" released by "delete_volume" :: held 6.762s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Flow 'volume_create_manager' (22ab59a9-8fbd-46c8-9064-cb13ec256399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2987e1c9-d16b-45e9-8467-187bbb7b1c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:22 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97" returned: 0 in 0.652s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2987e1c9-d16b-45e9-8467-187bbb7b1c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1350136498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22efda1-a7d1-46d2-85b9-c27134475d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a7b2e538dc494487b94ae7361e7bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:22Z,use_quota=True,user_id='b72a073732f149739be329cbc98023a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d07cc1-df5a-4ccc-bf62-2914a5e740ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d07cc1-df5a-4ccc-bf62-2914a5e740ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf5d0e4-cc5c-4250-a744-c0e3aacbbae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf5d0e4-cc5c-4250-a744-c0e3aacbbae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c22efda1-a7d1-46d2-85b9-c27134475d28', 'volume_name': 'volume-c22efda1-a7d1-46d2-85b9-c27134475d28', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfec90d0-f304-4896-bc28-2b622c15bec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:22 devstack sudo[86117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97
Apr 14 01:22:22 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfec90d0-f304-4896-bc28-2b622c15bec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e4f738-9d26-427a-8161-f641d788172c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:22 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Volume c22efda1-a7d1-46d2-85b9-c27134475d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c22efda1-a7d1-46d2-85b9-c27134475d28', 'volume_size': 1}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1350136498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22efda1-a7d1-46d2-85b9-c27134475d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a7b2e538dc494487b94ae7361e7bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:22Z,use_quota=True,user_id='b72a073732f149739be329cbc98023a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Creating volume c22efda1-a7d1-46d2-85b9-c27134475d28 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:22 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:22:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:22 devstack sudo[86120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28 1073741824
Apr 14 01:22:22 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:23 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-241567c2-5c9d-4378-ae90-be2b82528a97" returned: 0 in 0.565s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "cinder-quobyte-241567c2-5c9d-4378-ae90-be2b82528a97" released by "delete_volume" :: held 1.254s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Created reservations ['8b25c886-b10c-408a-b686-3c4f1aec5ebd', '74c848d1-8310-4f92-9d9c-85cba5db3a64', '2b6b5a2b-5317-4dbf-b0fa-40627f360f32', '52ff44c9-5482-4075-b70a-a78fc6ad13cc'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:23 devstack sudo[86126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:23 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:23 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28 1073741824" returned: 0 in 0.618s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:23 devstack sudo[86128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28
Apr 14 01:22:23 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:23 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28" returned: 0 in 0.467s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e4f738-9d26-427a-8161-f641d788172c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c22efda1-a7d1-46d2-85b9-c27134475d28', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ac2a09-9fad-417f-9307-cd3dad204670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:23 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Volume volume-c22efda1-a7d1-46d2-85b9-c27134475d28 (c22efda1-a7d1-46d2-85b9-c27134475d28): created successfully
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ac2a09-9fad-417f-9307-cd3dad204670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Flow 'volume_create_manager' (22ab59a9-8fbd-46c8-9064-cb13ec256399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:23 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.561s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:23 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e0cb9249-d3f1-41ae-bb83-52b9aeef4a35 tempest-VolumesDeleteCascade-1659295260 None] Created volume successfully.
Apr 14 01:22:23 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Deleted volume successfully.
Apr 14 01:22:23 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b8071d3b-453a-40d7-bfb4-c3169fa59b74 tempest-VolumesSnapshotNegativeTestJSON-411073959 None] Lock "cinder-241567c2-5c9d-4378-ae90-be2b82528a97-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] Creating offline snapshot 6ebb1590-230d-450e-9a25-aac80d7c1ea4 of volume c22efda1-a7d1-46d2-85b9-c27134475d28 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:22:24 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d1824b-4590-4b29-8815-c7ca61c65f3f]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:24 devstack sudo[86132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28
Apr 14 01:22:24 devstack sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:25 devstack sudo[86132]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28" returned: 0 in 0.659s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:25 devstack sudo[86137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4 1G
Apr 14 01:22:25 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:26 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4 1G" returned: 0 in 0.678s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c22efda1-a7d1-46d2-85b9-c27134475d28 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:26 devstack sudo[86142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c22efda1-a7d1-46d2-85b9-c27134475d28 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4
Apr 14 01:22:26 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Flow 'volume_create_manager' (99367486-4159-4cb7-882e-74b6a0dde6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b54a18-6bb7-4c12-9172-39727c3bd31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b54a18-6bb7-4c12-9172-39727c3bd31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-504061979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2642edd-cd47-410e-ba9e-c79894ed4620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8613a660f94f4442aa86940c6aac9e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:26Z,use_quota=True,user_id='cf38e9571a094dc580cc40317e9b4d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a7e853-072c-46cf-b8d5-d18a85b4ac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a7e853-072c-46cf-b8d5-d18a85b4ac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0caa044d-af0d-479b-b01b-9c702097a873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0caa044d-af0d-479b-b01b-9c702097a873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2642edd-cd47-410e-ba9e-c79894ed4620', 'volume_name': 'volume-e2642edd-cd47-410e-ba9e-c79894ed4620', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fdecd1-d7e7-47f7-8bbb-8851092086c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fdecd1-d7e7-47f7-8bbb-8851092086c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0695d877-adae-4c34-9dfb-b66418058fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Volume e2642edd-cd47-410e-ba9e-c79894ed4620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2642edd-cd47-410e-ba9e-c79894ed4620', 'volume_size': 1}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Flow 'volume_create_manager' (14197d81-ec1d-4f54-8516-76f58fb3ce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1cb36a0-b84b-40c1-b60e-983de516bcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1cb36a0-b84b-40c1-b60e-983de516bcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1112825880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38435e6e-5a47-4908-9fa1-9581103dcadd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8613a660f94f4442aa86940c6aac9e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:26Z,use_quota=True,user_id='cf38e9571a094dc580cc40317e9b4d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace7c4f9-4e6d-48ed-9c96-de7e56f77d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace7c4f9-4e6d-48ed-9c96-de7e56f77d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f3d703-d620-4300-9504-01ce3e88c4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f3d703-d620-4300-9504-01ce3e88c4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38435e6e-5a47-4908-9fa1-9581103dcadd', 'volume_name': 'volume-38435e6e-5a47-4908-9fa1-9581103dcadd', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426492e2-5c93-4ac0-87a2-0c2ca7d7ceb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426492e2-5c93-4ac0-87a2-0c2ca7d7ceb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7119fa4d-0bb9-427b-982f-dff3f25084cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Volume 38435e6e-5a47-4908-9fa1-9581103dcadd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38435e6e-5a47-4908-9fa1-9581103dcadd', 'volume_size': 1}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Flow 'volume_create_manager' (3f3bb658-1534-4a9f-8208-c5ce46d17eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9bfa44-4390-49c0-8e25-0420fe16c1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9bfa44-4390-49c0-8e25-0420fe16c1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-931941307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa67cbfc-2fd7-4958-8248-1f341aca03c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8613a660f94f4442aa86940c6aac9e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:27Z,use_quota=True,user_id='cf38e9571a094dc580cc40317e9b4d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee6d1fdc-fc8e-4c61-a348-320ae07b68c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee6d1fdc-fc8e-4c61-a348-320ae07b68c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad737550-2ec5-4b9d-868c-83dbb34035a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad737550-2ec5-4b9d-868c-83dbb34035a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa67cbfc-2fd7-4958-8248-1f341aca03c3', 'volume_name': 'volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7bc5295-cb57-44f9-9d2c-e256b2152faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7bc5295-cb57-44f9-9d2c-e256b2152faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68adfe94-7f04-4a6a-9d4d-f1c7cdbfbd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Volume aa67cbfc-2fd7-4958-8248-1f341aca03c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3', 'volume_size': 1}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:26 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c22efda1-a7d1-46d2-85b9-c27134475d28 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4" returned: 0 in 0.718s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:26 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4 is being set with open permissions: ugo+rw
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:26 devstack sudo[86147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4
Apr 14 01:22:26 devstack sudo[86147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Flow 'volume_create_manager' (84f0b715-d512-44bf-8a32-ccbf9ae52f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c65b95-01a4-4981-b5cd-69b14a3aa5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c65b95-01a4-4981-b5cd-69b14a3aa5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-112171183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dead86ed-cd45-4cf8-ad20-2880bd18910f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8613a660f94f4442aa86940c6aac9e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:27Z,use_quota=True,user_id='cf38e9571a094dc580cc40317e9b4d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e425f28f-edb0-415b-8f37-f2749c6a5c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e425f28f-edb0-415b-8f37-f2749c6a5c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47169cd0-50a0-40a1-b8fe-4cd798b94174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47169cd0-50a0-40a1-b8fe-4cd798b94174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dead86ed-cd45-4cf8-ad20-2880bd18910f', 'volume_name': 'volume-dead86ed-cd45-4cf8-ad20-2880bd18910f', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01268b0c-09fc-47c6-ba36-0a4921cf3df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01268b0c-09fc-47c6-ba36-0a4921cf3df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c062c9c-2610-4562-8b7e-a3a6f08dde1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:26 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Volume dead86ed-cd45-4cf8-ad20-2880bd18910f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dead86ed-cd45-4cf8-ad20-2880bd18910f', 'volume_size': 1}
Apr 14 01:22:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Flow 'volume_create_manager' (22c3a907-78b9-453d-a2d6-df1fc9935a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96824990-04a9-4589-b91a-773ee602add9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96824990-04a9-4589-b91a-773ee602add9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1725829791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af60c0c-f3d7-4db6-a586-45effd635813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8613a660f94f4442aa86940c6aac9e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:27Z,use_quota=True,user_id='cf38e9571a094dc580cc40317e9b4d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85385d5f-9442-469e-b8ae-ed240bcc7beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85385d5f-9442-469e-b8ae-ed240bcc7beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f011f7-cfbc-46b6-982f-72c4087a67e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f011f7-cfbc-46b6-982f-72c4087a67e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5af60c0c-f3d7-4db6-a586-45effd635813', 'volume_name': 'volume-5af60c0c-f3d7-4db6-a586-45effd635813', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5226ff-f6fb-4b2d-bb6c-00d138268c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5226ff-f6fb-4b2d-bb6c-00d138268c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51b32c4-b6aa-49a1-b389-25734ed7d1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:27 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Volume 5af60c0c-f3d7-4db6-a586-45effd635813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5af60c0c-f3d7-4db6-a586-45effd635813', 'volume_size': 1}
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:27 devstack sudo[86147]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4" returned: 0 in 0.536s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:27 devstack sudo[86173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.info
Apr 14 01:22:27 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:27 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.info" returned: 0 in 0.508s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:27 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.info is being set with open permissions: ugo+rw
Apr 14 01:22:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:27 devstack sudo[86178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.info
Apr 14 01:22:27 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:28 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.info" returned: 0 in 0.523s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.687s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.182s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:28 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-504061979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2642edd-cd47-410e-ba9e-c79894ed4620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8613a660f94f4442aa86940c6aac9e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:26Z,use_quota=True,user_id='cf38e9571a094dc580cc40317e9b4d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:22:28 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Creating volume e2642edd-cd47-410e-ba9e-c79894ed4620 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:22:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:28 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:28 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:28 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:28 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:22:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e2642edd-cd47-410e-ba9e-c79894ed4620 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:28 devstack sudo[86181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e2642edd-cd47-410e-ba9e-c79894ed4620 1073741824
Apr 14 01:22:28 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:28 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-68c5da22-d814-47b7-b7e9-2eb3bc986028 tempest-VolumesDeleteCascade-1659295260 None] Create snapshot completed successfully
Apr 14 01:22:29 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e2642edd-cd47-410e-ba9e-c79894ed4620 1073741824" returned: 0 in 0.584s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e2642edd-cd47-410e-ba9e-c79894ed4620 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:29 devstack sudo[86186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e2642edd-cd47-410e-ba9e-c79894ed4620
Apr 14 01:22:29 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Flow 'volume_create_manager' (2f4e5cc3-3229-4f71-93dd-d55e46810ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4baa6e78-0530-487e-b61c-d07811c817ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4baa6e78-0530-487e-b61c-d07811c817ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-772420974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49270f7-234f-429a-a4d0-57c588b69eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a7b2e538dc494487b94ae7361e7bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ebb1590-230d-450e-9a25-aac80d7c1ea4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:29Z,use_quota=True,user_id='b72a073732f149739be329cbc98023a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be70e64d-967d-4d77-b121-92147ab217a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be70e64d-967d-4d77-b121-92147ab217a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbf022f-7916-41d8-8fc8-24203f468f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbf022f-7916-41d8-8fc8-24203f468f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b49270f7-234f-429a-a4d0-57c588b69eae', 'volume_name': 'volume-b49270f7-234f-429a-a4d0-57c588b69eae', 'volume_size': 1, 'snapshot_id': '6ebb1590-230d-450e-9a25-aac80d7c1ea4'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178c56c7-6ef6-470d-84b8-741d3d0288d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178c56c7-6ef6-470d-84b8-741d3d0288d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734cdf53-e993-4d2f-b7f8-85889ff01154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:29 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Volume b49270f7-234f-429a-a4d0-57c588b69eae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b49270f7-234f-429a-a4d0-57c588b69eae', 'volume_size': 1, 'snapshot_id': '6ebb1590-230d-450e-9a25-aac80d7c1ea4'}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:29 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e2642edd-cd47-410e-ba9e-c79894ed4620" returned: 0 in 0.575s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.204s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1112825880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38435e6e-5a47-4908-9fa1-9581103dcadd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8613a660f94f4442aa86940c6aac9e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:26Z,use_quota=True,user_id='cf38e9571a094dc580cc40317e9b4d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Creating volume 38435e6e-5a47-4908-9fa1-9581103dcadd {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:29 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-38435e6e-5a47-4908-9fa1-9581103dcadd 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0695d877-adae-4c34-9dfb-b66418058fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2642edd-cd47-410e-ba9e-c79894ed4620', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad59f3d2-dafc-4afb-ab86-ccce61f7a770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:29 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Volume volume-e2642edd-cd47-410e-ba9e-c79894ed4620 (e2642edd-cd47-410e-ba9e-c79894ed4620): created successfully
Apr 14 01:22:29 devstack sudo[86190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-38435e6e-5a47-4908-9fa1-9581103dcadd 1073741824
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad59f3d2-dafc-4afb-ab86-ccce61f7a770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:29 devstack sudo[86190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:29 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Flow 'volume_create_manager' (99367486-4159-4cb7-882e-74b6a0dde6e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:29 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-1ddce110-8105-4083-9549-5325bc992038 tempest-CreateVolumesFromImageTest-242858463 None] Created volume successfully.
Apr 14 01:22:30 devstack sudo[86190]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-38435e6e-5a47-4908-9fa1-9581103dcadd 1073741824" returned: 0 in 0.589s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-38435e6e-5a47-4908-9fa1-9581103dcadd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:30 devstack sudo[86195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-38435e6e-5a47-4908-9fa1-9581103dcadd
Apr 14 01:22:30 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:30 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-c7e782f8-6f03-4fd2-989e-1160d3c06dce tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Terminate volume connection completed successfully.
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-c7e782f8-6f03-4fd2-989e-1160d3c06dce tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Deleting attachment cc660324-54fa-4331-b965-adc08489ca11. {{(pid=81812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 14 01:22:30 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-38435e6e-5a47-4908-9fa1-9581103dcadd" returned: 0 in 0.530s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.054s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-931941307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa67cbfc-2fd7-4958-8248-1f341aca03c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8613a660f94f4442aa86940c6aac9e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:27Z,use_quota=True,user_id='cf38e9571a094dc580cc40317e9b4d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Creating volume aa67cbfc-2fd7-4958-8248-1f341aca03c3 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:30 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7119fa4d-0bb9-427b-982f-dff3f25084cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38435e6e-5a47-4908-9fa1-9581103dcadd', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:30 devstack sudo[86198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3 1073741824
Apr 14 01:22:30 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4072f0-8ff8-4a45-b27d-0d74fa5ed4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:30 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Volume volume-38435e6e-5a47-4908-9fa1-9581103dcadd (38435e6e-5a47-4908-9fa1-9581103dcadd): created successfully
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4072f0-8ff8-4a45-b27d-0d74fa5ed4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Flow 'volume_create_manager' (14197d81-ec1d-4f54-8516-76f58fb3ce10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:30 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-75fd830f-04f2-49db-b1d2-a4c56b59f77f tempest-CreateVolumesFromImageTest-242858463 None] Created volume successfully.
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Acquiring lock "cinder-a8ad0900-164a-4428-984e-551275627fa4-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "cinder-a8ad0900-164a-4428-984e-551275627fa4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Acquiring lock "cinder-quobyte-a8ad0900-164a-4428-984e-551275627fa4" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "cinder-quobyte-a8ad0900-164a-4428-984e-551275627fa4" acquired by "delete_volume" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6264bffb-942d-4108-bb54-e5fe504d4059]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:31 devstack sudo[86200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4
Apr 14 01:22:31 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:31 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3 1073741824" returned: 0 in 0.519s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:31 devstack sudo[86205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3
Apr 14 01:22:31 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:31 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4" returned: 0 in 0.622s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:31 devstack sudo[86210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4
Apr 14 01:22:31 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:31 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3" returned: 0 in 0.488s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.858s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-112171183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dead86ed-cd45-4cf8-ad20-2880bd18910f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8613a660f94f4442aa86940c6aac9e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:27Z,use_quota=True,user_id='cf38e9571a094dc580cc40317e9b4d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Creating volume dead86ed-cd45-4cf8-ad20-2880bd18910f {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:31 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-dead86ed-cd45-4cf8-ad20-2880bd18910f 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68adfe94-7f04-4a6a-9d4d-f1c7cdbfbd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:31 devstack sudo[86213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-dead86ed-cd45-4cf8-ad20-2880bd18910f 1073741824
Apr 14 01:22:31 devstack sudo[86213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c830c5c-a95f-4992-bb36-305bc6061827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:31 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Volume volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3 (aa67cbfc-2fd7-4958-8248-1f341aca03c3): created successfully
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c830c5c-a95f-4992-bb36-305bc6061827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Flow 'volume_create_manager' (3f3bb658-1534-4a9f-8208-c5ce46d17eb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:31 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-7a783a1e-15e4-4cf1-bef2-32f8dbf8bdc5 tempest-CreateVolumesFromImageTest-242858463 None] Created volume successfully.
Apr 14 01:22:32 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a8ad0900-164a-4428-984e-551275627fa4" returned: 0 in 0.516s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "cinder-quobyte-a8ad0900-164a-4428-984e-551275627fa4" released by "delete_volume" :: held 1.179s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Flow 'volume_create_manager' (d67b9900-1777-4ba5-b7b9-18e957cd17ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b298cde3-38f5-44fb-ba99-075714e95728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b298cde3-38f5-44fb-ba99-075714e95728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-929531202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77548829-48bb-4c01-a1ce-6bc02731990f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bc68c0cbc9460297d012d1e7223302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:32Z,use_quota=True,user_id='956890275e714a48be2ec73c43b79827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9950db6d-aeda-43e5-a33f-975996295087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9950db6d-aeda-43e5-a33f-975996295087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de37467-dde7-49f9-ab46-813ffbf02edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de37467-dde7-49f9-ab46-813ffbf02edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77548829-48bb-4c01-a1ce-6bc02731990f', 'volume_name': 'volume-77548829-48bb-4c01-a1ce-6bc02731990f', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1dda546-4a49-4ec7-8c05-f4a90590bef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1dda546-4a49-4ec7-8c05-f4a90590bef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e300c613-8b01-4b24-a408-daa2592500ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:32 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Volume 77548829-48bb-4c01-a1ce-6bc02731990f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77548829-48bb-4c01-a1ce-6bc02731990f', 'volume_size': 1}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.quota [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Created reservations ['5702f2f0-2e64-42df-8115-09937efee2ad', '3e51ac52-6cb9-47b9-a5b2-263e6b38e8ee', '5691d93d-b11b-4086-8cd9-4c2ed6705e88', '1225b132-01a4-4b2e-9017-6d6c7e35393c'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:32 devstack sudo[86219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:32 devstack sudo[86219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:32 devstack sudo[86213]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-dead86ed-cd45-4cf8-ad20-2880bd18910f 1073741824" returned: 0 in 0.621s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-dead86ed-cd45-4cf8-ad20-2880bd18910f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:32 devstack sudo[86221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-dead86ed-cd45-4cf8-ad20-2880bd18910f
Apr 14 01:22:32 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:32 devstack sudo[86219]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.454s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.manager [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:32 devstack cinder-volume[81812]: INFO cinder.volume.manager [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Deleted volume successfully.
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.coordination [req-9a270b6e-0cdc-4810-90f1-ada04d34386e req-604cb8c2-8e64-48f7-957d-284d6cfed935 tempest-ServerBootFromVolumeStableRescueTest-358802188 None] Lock "cinder-a8ad0900-164a-4428-984e-551275627fa4-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:32 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-dead86ed-cd45-4cf8-ad20-2880bd18910f" returned: 0 in 0.472s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.760s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1725829791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af60c0c-f3d7-4db6-a586-45effd635813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8613a660f94f4442aa86940c6aac9e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:27Z,use_quota=True,user_id='cf38e9571a094dc580cc40317e9b4d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Creating volume 5af60c0c-f3d7-4db6-a586-45effd635813 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:32 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5af60c0c-f3d7-4db6-a586-45effd635813 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c062c9c-2610-4562-8b7e-a3a6f08dde1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dead86ed-cd45-4cf8-ad20-2880bd18910f', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:32 devstack sudo[86225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5af60c0c-f3d7-4db6-a586-45effd635813 1073741824
Apr 14 01:22:32 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a3da3e-20ad-4739-8624-0bc61a011168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:33 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Volume volume-dead86ed-cd45-4cf8-ad20-2880bd18910f (dead86ed-cd45-4cf8-ad20-2880bd18910f): created successfully
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a3da3e-20ad-4739-8624-0bc61a011168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Flow 'volume_create_manager' (84f0b715-d512-44bf-8a32-ccbf9ae52f7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:33 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8393d023-8b1e-48ea-863c-bd60b5dd96ce tempest-CreateVolumesFromImageTest-242858463 None] Created volume successfully.
Apr 14 01:22:33 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5af60c0c-f3d7-4db6-a586-45effd635813 1073741824" returned: 0 in 0.482s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5af60c0c-f3d7-4db6-a586-45effd635813 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:33 devstack sudo[86230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5af60c0c-f3d7-4db6-a586-45effd635813
Apr 14 01:22:33 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:33 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5af60c0c-f3d7-4db6-a586-45effd635813" returned: 0 in 0.428s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.553s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-quobyte-6ebb1590-230d-450e-9a25-aac80d7c1ea4-b49270f7-234f-429a-a4d0-57c588b69eae" by "_create_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51b32c4-b6aa-49a1-b389-25734ed7d1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5af60c0c-f3d7-4db6-a586-45effd635813', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9e0cae-996f-4ce4-898a-734b4d92acba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:33 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Volume volume-5af60c0c-f3d7-4db6-a586-45effd635813 (5af60c0c-f3d7-4db6-a586-45effd635813): created successfully
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9e0cae-996f-4ce4-898a-734b4d92acba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Flow 'volume_create_manager' (22c3a907-78b9-453d-a2d6-df1fc9935a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-6ebb1590-230d-450e-9a25-aac80d7c1ea4-b49270f7-234f-429a-a4d0-57c588b69eae" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Creating volume b49270f7-234f-429a-a4d0-57c588b69eae from snapshot 6ebb1590-230d-450e-9a25-aac80d7c1ea4 {{(pid=81812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-quobyte-b49270f7-234f-429a-a4d0-57c588b69eae" by "_copy_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-b49270f7-234f-429a-a4d0-57c588b69eae" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] snapshot: 6ebb1590-230d-450e-9a25-aac80d7c1ea4, volume: b49270f7-234f-429a-a4d0-57c588b69eae,  {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 14 01:22:33 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5adfe7e0-b009-441c-8091-ce10a1bec274 tempest-CreateVolumesFromImageTest-242858463 None] Created volume successfully.
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7881386a-4267-46a4-a3e3-cb1792cf38cc]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:34 devstack sudo[86233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4
Apr 14 01:22:34 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:34 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4" returned: 0 in 0.520s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c22efda1-a7d1-46d2-85b9-c27134475d28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28 {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 14 01:22:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Creating direct copy from snapshot {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 14 01:22:34 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d051f200-b9db-47e2-97dd-2c109a8eaf3d]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:34 devstack sudo[86238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28
Apr 14 01:22:34 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:34 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "cinder-5af60c0c-f3d7-4db6-a586-45effd635813-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:34 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-5af60c0c-f3d7-4db6-a586-45effd635813-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:34 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "cinder-quobyte-5af60c0c-f3d7-4db6-a586-45effd635813" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:34 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-quobyte-5af60c0c-f3d7-4db6-a586-45effd635813" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:34 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c266a4c-01c3-4d40-b5d6-8ad448dd159d]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5af60c0c-f3d7-4db6-a586-45effd635813 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:34 devstack sudo[86242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5af60c0c-f3d7-4db6-a586-45effd635813
Apr 14 01:22:34 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:35 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28" returned: 0 in 0.534s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:35 devstack cinder-volume[81812]: DEBUG cinder.utils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Path /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae not found in is_blk_device check {{(pid=81812) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 14 01:22:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:35 devstack sudo[86247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae
Apr 14 01:22:35 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:35 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5af60c0c-f3d7-4db6-a586-45effd635813" returned: 0 in 0.515s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5af60c0c-f3d7-4db6-a586-45effd635813 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:35 devstack sudo[86262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5af60c0c-f3d7-4db6-a586-45effd635813
Apr 14 01:22:35 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:36 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5af60c0c-f3d7-4db6-a586-45effd635813" returned: 0 in 1.124s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:36 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-quobyte-5af60c0c-f3d7-4db6-a586-45effd635813" released by "delete_volume" :: held 1.672s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:36 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Created reservations ['155bd25e-79e9-480c-ad8e-1769ef90b438', '6792b575-9d88-4770-93bd-b246779f7b46', '13b55993-1009-4da5-a4bb-2e59c8d6b1f9', 'f541bc25-6e87-4db6-baeb-1d776d7a3d05'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:36 devstack sudo[86294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:36 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "cinder-dead86ed-cd45-4cf8-ad20-2880bd18910f-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-dead86ed-cd45-4cf8-ad20-2880bd18910f-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "cinder-quobyte-dead86ed-cd45-4cf8-ad20-2880bd18910f" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-quobyte-dead86ed-cd45-4cf8-ad20-2880bd18910f" acquired by "delete_volume" :: waited 0.017s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:37 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18e2fa7-2ae4-471e-b7ca-c6a8b1426edb]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-dead86ed-cd45-4cf8-ad20-2880bd18910f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:37 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae" returned: 0 in 2.489s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:37 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[67940aff-8b95-44c8-96b5-b73306561312]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:37 devstack sudo[86297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-dead86ed-cd45-4cf8-ad20-2880bd18910f
Apr 14 01:22:37 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:37 devstack sudo[86298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28
Apr 14 01:22:37 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:37 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 1.024s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:37 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:37 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Deleted volume successfully.
Apr 14 01:22:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-91f7646d-4df2-4ec1-997e-bf2de0bf65b0 tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-5af60c0c-f3d7-4db6-a586-45effd635813-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:38 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-dead86ed-cd45-4cf8-ad20-2880bd18910f" returned: 0 in 0.613s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-dead86ed-cd45-4cf8-ad20-2880bd18910f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:38 devstack sudo[86308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-dead86ed-cd45-4cf8-ad20-2880bd18910f
Apr 14 01:22:38 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:38 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28" returned: 0 in 0.659s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:22:38 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Converted 1024.00 MB image at 411.17 MB/s
Apr 14 01:22:38 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae is being set with open permissions: ugo+rw
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:38 devstack sudo[86311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae
Apr 14 01:22:38 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:38 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-dead86ed-cd45-4cf8-ad20-2880bd18910f" returned: 0 in 0.447s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-quobyte-dead86ed-cd45-4cf8-ad20-2880bd18910f" released by "delete_volume" :: held 1.145s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Created reservations ['0e229e15-5d68-4f93-89e2-68bf18ec4d7d', 'b1e7c714-81af-419a-b4f4-b1e7db46cabd', '09ccb10a-04e6-4b7d-b764-c7b18d259a07', '33cbfd6b-c660-4203-8d0c-39fe175aa0f2'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:38 devstack sudo[86315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:38 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:38 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae" returned: 0 in 0.502s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-b49270f7-234f-429a-a4d0-57c588b69eae" released by "_copy_volume_from_snapshot" :: held 4.762s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-6ebb1590-230d-450e-9a25-aac80d7c1ea4-b49270f7-234f-429a-a4d0-57c588b69eae" released by "_create_volume_from_snapshot" :: held 4.780s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.811s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.374s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-929531202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77548829-48bb-4c01-a1ce-6bc02731990f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bc68c0cbc9460297d012d1e7223302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:32Z,use_quota=True,user_id='956890275e714a48be2ec73c43b79827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Creating volume 77548829-48bb-4c01-a1ce-6bc02731990f {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:38 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-77548829-48bb-4c01-a1ce-6bc02731990f 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:38 devstack sudo[86317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-77548829-48bb-4c01-a1ce-6bc02731990f 1073741824
Apr 14 01:22:38 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734cdf53-e993-4d2f-b7f8-85889ff01154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49270f7-234f-429a-a4d0-57c588b69eae', 'volume_size': 1, 'snapshot_id': '6ebb1590-230d-450e-9a25-aac80d7c1ea4'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286de10d-03d0-4dd9-8543-951f491b65d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:38 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Volume volume-b49270f7-234f-429a-a4d0-57c588b69eae (b49270f7-234f-429a-a4d0-57c588b69eae): created successfully
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286de10d-03d0-4dd9-8543-951f491b65d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Flow 'volume_create_manager' (2f4e5cc3-3229-4f71-93dd-d55e46810ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:38 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-da147db7-95f7-40ad-9d95-20d04206fe43 tempest-VolumesDeleteCascade-1659295260 None] Created volume successfully.
Apr 14 01:22:39 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.483s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:39 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Deleted volume successfully.
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a0d99a86-d917-470f-9701-425acff36eec tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-dead86ed-cd45-4cf8-ad20-2880bd18910f-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:39 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-77548829-48bb-4c01-a1ce-6bc02731990f 1073741824" returned: 0 in 0.482s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-77548829-48bb-4c01-a1ce-6bc02731990f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:39 devstack sudo[86323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-77548829-48bb-4c01-a1ce-6bc02731990f
Apr 14 01:22:39 devstack sudo[86323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "cinder-aa67cbfc-2fd7-4958-8248-1f341aca03c3-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-aa67cbfc-2fd7-4958-8248-1f341aca03c3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "cinder-quobyte-aa67cbfc-2fd7-4958-8248-1f341aca03c3" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-quobyte-aa67cbfc-2fd7-4958-8248-1f341aca03c3" acquired by "delete_volume" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4231c04f-f0fc-45d3-b8ab-8ba12f5b9b53]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:39 devstack sudo[86325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3
Apr 14 01:22:39 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:39 devstack sudo[86323]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-77548829-48bb-4c01-a1ce-6bc02731990f" returned: 0 in 0.425s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e300c613-8b01-4b24-a408-daa2592500ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77548829-48bb-4c01-a1ce-6bc02731990f', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2e79f2-e13d-4443-aabe-09e93cee6159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:39 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Volume volume-77548829-48bb-4c01-a1ce-6bc02731990f (77548829-48bb-4c01-a1ce-6bc02731990f): created successfully
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2e79f2-e13d-4443-aabe-09e93cee6159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Flow 'volume_create_manager' (d67b9900-1777-4ba5-b7b9-18e957cd17ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:39 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-22497583-7bbd-45af-977c-602cdf35568e tempest-VolumesServicesTestJSON-1344389176 None] Created volume successfully.
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-c22efda1-a7d1-46d2-85b9-c27134475d28-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Acquiring lock "cinder-77548829-48bb-4c01-a1ce-6bc02731990f-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-c22efda1-a7d1-46d2-85b9-c27134475d28-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Lock "cinder-77548829-48bb-4c01-a1ce-6bc02731990f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Acquiring lock "cinder-quobyte-77548829-48bb-4c01-a1ce-6bc02731990f" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Performing cascade delete. {{(pid=81812) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-6ebb1590-230d-450e-9a25-aac80d7c1ea4-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Lock "cinder-quobyte-77548829-48bb-4c01-a1ce-6bc02731990f" acquired by "delete_volume" :: waited 0.029s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-6ebb1590-230d-450e-9a25-aac80d7c1ea4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[18457b62-f47b-433a-b1d6-a5b7e405e5a9]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-77548829-48bb-4c01-a1ce-6bc02731990f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-quobyte-c22efda1-a7d1-46d2-85b9-c27134475d28" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-c22efda1-a7d1-46d2-85b9-c27134475d28" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-quobyte-6ebb1590-230d-450e-9a25-aac80d7c1ea4" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-6ebb1590-230d-450e-9a25-aac80d7c1ea4" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Deleting offline snapshot 6ebb1590-230d-450e-9a25-aac80d7c1ea4 of volume c22efda1-a7d1-46d2-85b9-c27134475d28 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] snapshot_file for this snap is: volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e228b3e3-2e7a-4933-b4e4-8a8a3739581d]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:40 devstack sudo[86328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-77548829-48bb-4c01-a1ce-6bc02731990f
Apr 14 01:22:40 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:40 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3" returned: 0 in 0.575s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:40 devstack sudo[86332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4
Apr 14 01:22:40 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:40 devstack sudo[86334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3
Apr 14 01:22:40 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:40 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-77548829-48bb-4c01-a1ce-6bc02731990f" returned: 0 in 0.489s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-77548829-48bb-4c01-a1ce-6bc02731990f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:40 devstack sudo[86344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-77548829-48bb-4c01-a1ce-6bc02731990f
Apr 14 01:22:40 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:40 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aa67cbfc-2fd7-4958-8248-1f341aca03c3" returned: 0 in 0.460s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:40 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4" returned: 0 in 0.525s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c22efda1-a7d1-46d2-85b9-c27134475d28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-quobyte-aa67cbfc-2fd7-4958-8248-1f341aca03c3" released by "delete_volume" :: held 1.078s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0110686-9613-49d6-b360-5c7bfb1b033f]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Created reservations ['dd7778da-4b37-4b26-9744-0ad2b6128103', '5ab41307-e65f-4b7d-b37f-690124d616d7', '7514e61e-b0e4-46fc-bdbd-73b96dfc255f', '83c748f4-5515-43be-a73e-43fbab7551b2'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:40 devstack sudo[86346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28
Apr 14 01:22:40 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:40 devstack sudo[86348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:40 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:40 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-77548829-48bb-4c01-a1ce-6bc02731990f" returned: 0 in 0.456s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Lock "cinder-quobyte-77548829-48bb-4c01-a1ce-6bc02731990f" released by "delete_volume" :: held 0.984s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Created reservations ['c606836d-8af1-490a-b4e2-59bd486340cb', 'e6f950f2-9b27-4383-ac46-20df8f4c20a9', 'b1612e8e-1d62-40e9-80bf-4f2efb3a7c64', 'f992569e-0ef6-4acb-829a-72383084b24f'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:41 devstack sudo[86355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:41 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:41 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:41 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.485s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28" returned: 0 in 0.561s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:41 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Deleted volume successfully.
Apr 14 01:22:41 devstack sudo[86357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4
Apr 14 01:22:41 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4388bcc5-5fb0-4146-bf0b-37d57cd087ac tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-aa67cbfc-2fd7-4958-8248-1f341aca03c3-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:41 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.411s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:41 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Deleted volume successfully.
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-550e0401-19b8-4151-bed6-d700cef74dcb tempest-VolumesServicesTestJSON-1344389176 None] Lock "cinder-77548829-48bb-4c01-a1ce-6bc02731990f-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:41 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "cinder-38435e6e-5a47-4908-9fa1-9581103dcadd-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4" returned: 0 in 0.486s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-38435e6e-5a47-4908-9fa1-9581103dcadd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:41 devstack sudo[86363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4
Apr 14 01:22:41 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "cinder-quobyte-38435e6e-5a47-4908-9fa1-9581103dcadd" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-quobyte-38435e6e-5a47-4908-9fa1-9581103dcadd" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ea185f-d4e2-4bf0-97d3-abb1d31500f9]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-38435e6e-5a47-4908-9fa1-9581103dcadd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:41 devstack sudo[86365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-38435e6e-5a47-4908-9fa1-9581103dcadd
Apr 14 01:22:41 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:42 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28.6ebb1590-230d-450e-9a25-aac80d7c1ea4" returned: 0 in 0.485s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-6ebb1590-230d-450e-9a25-aac80d7c1ea4" released by "_delete_snapshot" :: held 2.106s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-c22efda1-a7d1-46d2-85b9-c27134475d28" released by "delete_snapshot" :: held 2.118s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Created reservations ['bc390b12-1221-4cd6-b951-ceaa0f5dac0e', '7488e221-6364-47ad-84fd-a469bf5557d8', 'b9a8ea46-eb4c-4e03-8065-896564ccf36b', '38d58b80-0c94-438d-8239-be994b65b41c'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:42 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-38435e6e-5a47-4908-9fa1-9581103dcadd" returned: 0 in 0.495s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-38435e6e-5a47-4908-9fa1-9581103dcadd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:42 devstack sudo[86371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-38435e6e-5a47-4908-9fa1-9581103dcadd
Apr 14 01:22:42 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:42 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Delete snapshot completed successfully.
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-6ebb1590-230d-450e-9a25-aac80d7c1ea4-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Snapshots deleted, issuing volume delete {{(pid=81812) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-quobyte-c22efda1-a7d1-46d2-85b9-c27134475d28" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-c22efda1-a7d1-46d2-85b9-c27134475d28" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[af01e456-a51f-495b-b568-eb53607560d9]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:42 devstack sudo[86373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28
Apr 14 01:22:42 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:42 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-38435e6e-5a47-4908-9fa1-9581103dcadd" returned: 0 in 0.461s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-quobyte-38435e6e-5a47-4908-9fa1-9581103dcadd" released by "delete_volume" :: held 0.978s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:UPDATE=202,cinder:SELECT=168,cinder:DELETE=21,cinder:INSERT=50 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Created reservations ['dff87759-c872-48f5-9307-0b213e39d9c1', 'b579cad1-705b-4292-bdd4-6cfbc4d4535e', 'fd42250c-fe1e-4597-b140-ee408598453b', '8b2fe49c-2ac8-4d04-a228-f7a8d33406e8'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:42 devstack sudo[86376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:42 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "cinder-e2642edd-cd47-410e-ba9e-c79894ed4620-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-e2642edd-cd47-410e-ba9e-c79894ed4620-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "cinder-quobyte-e2642edd-cd47-410e-ba9e-c79894ed4620" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-quobyte-e2642edd-cd47-410e-ba9e-c79894ed4620" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[50023bbb-5665-448f-8d0a-ee9d930ca64a]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e2642edd-cd47-410e-ba9e-c79894ed4620 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:43 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28" returned: 0 in 0.718s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:43 devstack sudo[86382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28
Apr 14 01:22:43 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:43 devstack sudo[86381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e2642edd-cd47-410e-ba9e-c79894ed4620
Apr 14 01:22:43 devstack sudo[86381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:43 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.639s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:43 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Deleted volume successfully.
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-696436af-32c5-4364-ab31-8144ac84ba30 tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-38435e6e-5a47-4908-9fa1-9581103dcadd-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:43 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c22efda1-a7d1-46d2-85b9-c27134475d28" returned: 0 in 0.569s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-c22efda1-a7d1-46d2-85b9-c27134475d28" released by "delete_volume" :: held 1.324s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Created reservations ['d3c280b7-be5a-4b1e-b132-864b2660b884', '9d1abac2-a4ff-4427-b384-87b39261cdb3', '317e0ce8-fff2-43d0-ab2d-b8c4c662c35d', 'f502ba47-cf14-407a-aff5-4fd4cb1237f5'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:UPDATE=237,cinder:DELETE=16,cinder:SELECT=186,cinder:INSERT=62 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:43 devstack sudo[86391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:43 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:43 devstack sudo[86381]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e2642edd-cd47-410e-ba9e-c79894ed4620" returned: 0 in 0.824s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e2642edd-cd47-410e-ba9e-c79894ed4620 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:43 devstack sudo[86393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e2642edd-cd47-410e-ba9e-c79894ed4620
Apr 14 01:22:43 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:44 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e2642edd-cd47-410e-ba9e-c79894ed4620" returned: 0 in 0.508s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-quobyte-e2642edd-cd47-410e-ba9e-c79894ed4620" released by "delete_volume" :: held 1.374s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:44 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.632s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:44 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Deleted volume successfully.
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f97922b6-94b8-4dc0-85bb-9dc717e976cb tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-c22efda1-a7d1-46d2-85b9-c27134475d28-delete_volume" released by "delete_volume" :: held 4.439s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-b49270f7-234f-429a-a4d0-57c588b69eae-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Created reservations ['7d8ed14a-b204-4c62-873d-8c9839acf4d6', '372b97a4-caaa-46d8-90f1-4be5114a48de', '554b9331-84fa-48d0-95a3-4ac72e6b84c3', 'ec625798-7fda-42db-8219-3b3eba10f669'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-b49270f7-234f-429a-a4d0-57c588b69eae-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "cinder-quobyte-b49270f7-234f-429a-a4d0-57c588b69eae" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-b49270f7-234f-429a-a4d0-57c588b69eae" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dd63a6-e26f-4a9b-bca9-82382bb833e4]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:44 devstack sudo[86398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:44 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:44 devstack sudo[86397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae
Apr 14 01:22:44 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:45 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae" returned: 0 in 0.622s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:45 devstack sudo[86406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae
Apr 14 01:22:45 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:45 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.645s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:45 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:45 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Deleted volume successfully.
Apr 14 01:22:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-cfd7d63b-1e8a-4435-a1b2-27d68bace6c5 tempest-CreateVolumesFromImageTest-242858463 None] Lock "cinder-e2642edd-cd47-410e-ba9e-c79894ed4620-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:45 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b49270f7-234f-429a-a4d0-57c588b69eae" returned: 0 in 0.552s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-quobyte-b49270f7-234f-429a-a4d0-57c588b69eae" released by "delete_volume" :: held 1.197s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:45 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Created reservations ['93ec732c-7e03-4bd2-9e2f-6e9afbb22e4a', 'c956980e-5000-42cd-ac3b-0a38f75c76e4', 'f6bac35f-abd2-4387-a0d1-27c64cb49427', '0fa4eab9-e14f-4835-b943-809db38c2f26'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:45 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:45 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:45 devstack sudo[86409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:45 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:46 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.477s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:46 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Deleted volume successfully.
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-39517f7c-72e9-4c14-a9a1-2040a8d07263 tempest-VolumesDeleteCascade-1659295260 None] Lock "cinder-b49270f7-234f-429a-a4d0-57c588b69eae-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Flow 'volume_create_manager' (5bf022dd-f993-4c47-88e5-4468b04aff7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c1ee3b-68fb-4f1a-89dd-f80f413ddf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c1ee3b-68fb-4f1a-89dd-f80f413ddf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-63121186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4bb032-6eda-4611-b0dd-c0d9f6998b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4470d2449d674354b617278c01501be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:47Z,use_quota=True,user_id='a08b8c2a569640a4b65bd28da4a88062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83d5937-3e77-42f8-940a-f4e726280368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83d5937-3e77-42f8-940a-f4e726280368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbc2824-ea73-4f06-b96d-7d7125170087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbc2824-ea73-4f06-b96d-7d7125170087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce4bb032-6eda-4611-b0dd-c0d9f6998b5f', 'volume_name': 'volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3674ed56-ef8e-4043-b3ac-1dcbf7f923fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3674ed56-ef8e-4043-b3ac-1dcbf7f923fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30094d83-7496-4442-b174-74e3ff2ff698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:46 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Volume ce4bb032-6eda-4611-b0dd-c0d9f6998b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f', 'volume_size': 1}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-63121186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4bb032-6eda-4611-b0dd-c0d9f6998b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4470d2449d674354b617278c01501be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:47Z,use_quota=True,user_id='a08b8c2a569640a4b65bd28da4a88062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Creating volume ce4bb032-6eda-4611-b0dd-c0d9f6998b5f {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:46 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:22:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:46 devstack sudo[86412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f 1073741824
Apr 14 01:22:46 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:47 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f 1073741824" returned: 0 in 0.597s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:47 devstack sudo[86418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f
Apr 14 01:22:47 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Flow 'volume_create_manager' (61678fea-2074-4dc8-9ef3-c7c1d335af0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187a8554-7877-4fa8-b800-7a2ab781de3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187a8554-7877-4fa8-b800-7a2ab781de3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300d7c1474eb41a5b6278b956a272b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:47Z,use_quota=True,user_id='88175fe1ba3f40e6a4102f77f364fde4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d782340-dc4c-446a-810a-482a61808254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d782340-dc4c-446a-810a-482a61808254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b2a0d3-75e4-4743-8bde-4edabd88c859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b2a0d3-75e4-4743-8bde-4edabd88c859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3', 'volume_name': 'volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365dc25d-9893-45a8-a633-108d22b6ba05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365dc25d-9893-45a8-a633-108d22b6ba05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f07bd6-ff2c-4960-ade9-267d84f48338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:47 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Volume b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3', 'volume_size': 1}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:47 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f" returned: 0 in 0.604s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.308s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300d7c1474eb41a5b6278b956a272b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:47Z,use_quota=True,user_id='88175fe1ba3f40e6a4102f77f364fde4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Creating volume b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:47 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30094d83-7496-4442-b174-74e3ff2ff698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83f52b0-5a51-416e-bc96-180331e79db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:47 devstack sudo[86421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3 1073741824
Apr 14 01:22:47 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:47 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Volume volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f (ce4bb032-6eda-4611-b0dd-c0d9f6998b5f): created successfully
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83f52b0-5a51-416e-bc96-180331e79db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Flow 'volume_create_manager' (5bf022dd-f993-4c47-88e5-4468b04aff7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:47 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e681a170-f294-4d74-adc7-251e481b719b tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Created volume successfully.
Apr 14 01:22:48 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3 1073741824" returned: 0 in 0.577s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:48 devstack sudo[86426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3
Apr 14 01:22:48 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Flow 'volume_create_manager' (4dd04a1e-ae55-400d-afbe-b690048206eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5a9161-0966-4f43-ae07-5a51d7971113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5a9161-0966-4f43-ae07-5a51d7971113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2121301800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9658a97-7c6f-4b8a-a8af-bd4da392183d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b94ae488d8f4baaa4bd1e668b595bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:49Z,use_quota=True,user_id='e03cd1221baa4a6b9b61ee0418cb1027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff1b47f-6030-43b6-bfbf-33051c700d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:48 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff1b47f-6030-43b6-bfbf-33051c700d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9af2ba-64f8-49f8-b066-0641b39352f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9af2ba-64f8-49f8-b066-0641b39352f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9658a97-7c6f-4b8a-a8af-bd4da392183d', 'volume_name': 'volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d', 'volume_size': 2}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde80771-22ff-4760-9f51-3d0dd8369665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde80771-22ff-4760-9f51-3d0dd8369665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251fed57-8904-4057-9c66-1937d771bfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:48 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Volume f9658a97-7c6f-4b8a-a8af-bd4da392183d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d', 'volume_size': 2}
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3" returned: 0 in 0.475s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.036s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f07bd6-ff2c-4960-ade9-267d84f48338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491d81c3-0c19-4494-b99c-385acb568c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Creating offline snapshot 200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c of volume ce4bb032-6eda-4611-b0dd-c0d9f6998b5f {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:22:49 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Volume volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3 (b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3): created successfully
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491d81c3-0c19-4494-b99c-385acb568c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Flow 'volume_create_manager' (61678fea-2074-4dc8-9ef3-c7c1d335af0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4db8731-bc12-4280-8dfd-4589de0fac05]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:49 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ad2a674f-addb-4558-9b6b-b95d1797d6f0 tempest-CinderUnicodeTest-1540529963 None] Created volume successfully.
Apr 14 01:22:49 devstack sudo[86430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f
Apr 14 01:22:49 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:49 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f" returned: 0 in 0.547s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:49 devstack sudo[86435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c 1G
Apr 14 01:22:49 devstack sudo[86435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Flow 'volume_create_manager' (1a81eda5-b5cd-48c9-8f98-4b44979f909f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ec16a9-920b-422c-9712-c0ed41d25ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ec16a9-920b-422c-9712-c0ed41d25ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1666969005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974a93bd-e198-4481-99b8-98c51ef46204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300d7c1474eb41a5b6278b956a272b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:50Z,use_quota=True,user_id='88175fe1ba3f40e6a4102f77f364fde4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b07fed-f326-494e-83cd-4558d42e4a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b07fed-f326-494e-83cd-4558d42e4a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024118cf-8406-427e-84ce-6b9fca91555f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024118cf-8406-427e-84ce-6b9fca91555f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '974a93bd-e198-4481-99b8-98c51ef46204', 'volume_name': 'volume-974a93bd-e198-4481-99b8-98c51ef46204', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fe9c6c-e8b8-4d2e-aca0-1df113a913bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fe9c6c-e8b8-4d2e-aca0-1df113a913bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2784547d-ebad-467b-a330-868ac43d2692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:49 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Volume 974a93bd-e198-4481-99b8-98c51ef46204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-974a93bd-e198-4481-99b8-98c51ef46204', 'volume_size': 1}
Apr 14 01:22:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:50 devstack sudo[86435]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c 1G" returned: 0 in 0.522s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:50 devstack sudo[86440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c
Apr 14 01:22:50 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:50 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c" returned: 0 in 0.419s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:50 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c is being set with open permissions: ugo+rw
Apr 14 01:22:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:50 devstack sudo[86445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c
Apr 14 01:22:50 devstack sudo[86445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:51 devstack sudo[86445]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c" returned: 0 in 0.501s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:51 devstack sudo[86448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.info
Apr 14 01:22:51 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:51 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.info" returned: 0 in 0.415s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:51 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.info is being set with open permissions: ugo+rw
Apr 14 01:22:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:51 devstack sudo[86451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.info
Apr 14 01:22:51 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:51 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.info" returned: 0 in 0.514s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.013s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2121301800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9658a97-7c6f-4b8a-a8af-bd4da392183d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b94ae488d8f4baaa4bd1e668b595bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:49Z,use_quota=True,user_id='e03cd1221baa4a6b9b61ee0418cb1027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:22:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Creating volume f9658a97-7c6f-4b8a-a8af-bd4da392183d {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:22:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:52 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:22:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d 2147483648 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:52 devstack sudo[86454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d 2147483648
Apr 14 01:22:52 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:52 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5e9858bd-4b91-409f-9715-cedd4e19327f tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Create snapshot completed successfully
Apr 14 01:22:52 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d 2147483648" returned: 0 in 0.673s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:52 devstack sudo[86459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d
Apr 14 01:22:52 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:53 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d" returned: 0 in 0.567s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.358s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1666969005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974a93bd-e198-4481-99b8-98c51ef46204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300d7c1474eb41a5b6278b956a272b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:50Z,use_quota=True,user_id='88175fe1ba3f40e6a4102f77f364fde4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Creating volume 974a93bd-e198-4481-99b8-98c51ef46204 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:53 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251fed57-8904-4057-9c66-1937d771bfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d', 'volume_size': 2}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10b9dab-eff7-49ae-8a99-5dd39f0099ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:53 devstack sudo[86463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204 1073741824
Apr 14 01:22:53 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:53 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Volume volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d (f9658a97-7c6f-4b8a-a8af-bd4da392183d): created successfully
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10b9dab-eff7-49ae-8a99-5dd39f0099ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Flow 'volume_create_manager' (4dd04a1e-ae55-400d-afbe-b690048206eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:53 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-1b0235a3-6e8a-473f-8bad-5bdfea4d9b5d tempest-VolumesCloneNegativeTest-411920600 None] Created volume successfully.
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Acquiring lock "cinder-200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "cinder-200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Acquiring lock "cinder-quobyte-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "cinder-quobyte-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Acquiring lock "cinder-quobyte-200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "cinder-quobyte-200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Deleting offline snapshot 200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c of volume ce4bb032-6eda-4611-b0dd-c0d9f6998b5f {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] snapshot_file for this snap is: volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7a3938-10fe-466b-8072-7391393e70b9]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:53 devstack sudo[86465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c
Apr 14 01:22:53 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:53 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204 1073741824" returned: 0 in 0.572s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:53 devstack sudo[86470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204
Apr 14 01:22:53 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:54 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c" returned: 0 in 0.745s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce01fedb-f1a3-4412-af3f-89e87fac2189]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:54 devstack sudo[86475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f
Apr 14 01:22:54 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Acquiring lock "cinder-f9658a97-7c6f-4b8a-a8af-bd4da392183d-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Lock "cinder-f9658a97-7c6f-4b8a-a8af-bd4da392183d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Acquiring lock "cinder-quobyte-f9658a97-7c6f-4b8a-a8af-bd4da392183d" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Lock "cinder-quobyte-f9658a97-7c6f-4b8a-a8af-bd4da392183d" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7111b6a1-1569-4cb0-b714-c85e60cddb71]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:54 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204" returned: 0 in 0.567s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2784547d-ebad-467b-a330-868ac43d2692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-974a93bd-e198-4481-99b8-98c51ef46204', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbd87b0-01e4-48cc-afa7-60e94638750d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:54 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Volume volume-974a93bd-e198-4481-99b8-98c51ef46204 (974a93bd-e198-4481-99b8-98c51ef46204): created successfully
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbd87b0-01e4-48cc-afa7-60e94638750d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Flow 'volume_create_manager' (1a81eda5-b5cd-48c9-8f98-4b44979f909f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:54 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-34322860-5889-4fa0-b08b-9ca6d77e46c1 tempest-CinderUnicodeTest-1540529963 None] Created volume successfully.
Apr 14 01:22:54 devstack sudo[86478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d
Apr 14 01:22:54 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:54 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f" returned: 0 in 0.608s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:54 devstack sudo[86486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c
Apr 14 01:22:54 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:55 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d" returned: 0 in 0.566s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:55 devstack sudo[86491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d
Apr 14 01:22:55 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:55 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c" returned: 0 in 0.549s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:55 devstack sudo[86497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:55 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] Creating offline snapshot 70446f5d-c124-4ace-8ec2-6d4a7d166718 of volume 974a93bd-e198-4481-99b8-98c51ef46204 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d2fb27-9bb2-40a3-a423-75e9822315d1]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:55 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9658a97-7c6f-4b8a-a8af-bd4da392183d" returned: 0 in 0.444s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Lock "cinder-quobyte-f9658a97-7c6f-4b8a-a8af-bd4da392183d" released by "delete_volume" :: held 1.040s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Created reservations ['7fa949f6-8ae4-41f2-872b-0681e15abc80', '83a836a9-fb5b-4161-8923-e1e8f6147daf', 'c4539555-3036-4d64-bd3b-73445a6a971e', 'ba15a2a4-e765-4d4d-b244-dbc272add91a'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:55 devstack sudo[86499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204
Apr 14 01:22:55 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:55 devstack sudo[86501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:55 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:55 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f.200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c" returned: 0 in 0.492s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "cinder-quobyte-200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c" released by "_delete_snapshot" :: held 2.466s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "cinder-quobyte-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f" released by "delete_snapshot" :: held 2.478s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Created reservations ['a4b8fef6-ee58-4e32-948a-6e3e760bbb96', 'e9555153-7049-4c60-8407-023116d158b5', 'cb337126-20bf-408f-af1d-fce7999014d1', 'c0534841-8183-4e4b-87ad-1f72f7315e55'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:55 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204" returned: 0 in 0.538s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:55 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Delete snapshot completed successfully.
Apr 14 01:22:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d91a9af5-e9ee-4203-825c-fb7d1f4bc360 tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "cinder-200f1ed5-d4bd-4ad5-8165-1e81eb9b2d6c-delete_snapshot" released by "delete_snapshot" :: held 2.594s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:56 devstack sudo[86508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718 1G
Apr 14 01:22:56 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:56 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.459s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:56 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:56 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Deleted volume successfully.
Apr 14 01:22:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-61230589-8c08-4370-b54a-5b64aaa68b55 tempest-VolumesCloneNegativeTest-411920600 None] Lock "cinder-f9658a97-7c6f-4b8a-a8af-bd4da392183d-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:56 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718 1G" returned: 0 in 0.473s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974a93bd-e198-4481-99b8-98c51ef46204 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:56 devstack sudo[86513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974a93bd-e198-4481-99b8-98c51ef46204 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718
Apr 14 01:22:56 devstack sudo[86513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Acquiring lock "cinder-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "cinder-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Acquiring lock "cinder-quobyte-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "cinder-quobyte-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:56 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc49486-0bb3-4a5b-a090-b4c2e038c6a4]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:56 devstack sudo[86515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f
Apr 14 01:22:56 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:56 devstack sudo[86513]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974a93bd-e198-4481-99b8-98c51ef46204 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718" returned: 0 in 0.530s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:56 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718 is being set with open permissions: ugo+rw
Apr 14 01:22:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:57 devstack sudo[86520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718
Apr 14 01:22:57 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:57 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f" returned: 0 in 0.538s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:57 devstack sudo[86525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f
Apr 14 01:22:57 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:57 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718" returned: 0 in 0.506s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:57 devstack sudo[86529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.info
Apr 14 01:22:57 devstack sudo[86529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:57 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f" returned: 0 in 0.605s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "cinder-quobyte-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f" released by "delete_volume" :: held 1.183s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:57 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Created reservations ['644a4eaa-f0fc-4b3b-9206-c082aa3986ef', '53fb587b-e02d-42ac-a7f0-5b07a28294f8', '7c29d7c6-dddf-44cb-a2f0-dff981441874', '78838bbc-f739-41fd-8116-f835d3c8951d'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:22:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:57 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:57 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:57 devstack sudo[86533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:22:57 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:57 devstack sudo[86529]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.info" returned: 0 in 0.485s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:58 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.info is being set with open permissions: ugo+rw
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:58 devstack sudo[86535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.info
Apr 14 01:22:58 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:22:58 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Flow 'volume_create_manager' (c757790d-5157-4f57-b5d1-b4c8de6cc61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2c3dda-0341-418c-8fae-564143119456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2c3dda-0341-418c-8fae-564143119456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-672458215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f3e7bf-177a-47ff-804d-bbc72012e9e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08885cd008154a51a10261751ce1489a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:58Z,use_quota=True,user_id='725340ec7e6d4c5b8f0ff54ec076f657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d009472c-80eb-4ffe-a120-eeb14948f1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d009472c-80eb-4ffe-a120-eeb14948f1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8cd35a2-b172-47b6-8526-e190a510d035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8cd35a2-b172-47b6-8526-e190a510d035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f3e7bf-177a-47ff-804d-bbc72012e9e2', 'volume_name': 'volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:58 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329e7848-d2e8-4f2f-8f5a-4c43ac93c9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329e7848-d2e8-4f2f-8f5a-4c43ac93c9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd36f4e7-ec01-4935-840d-4b9b6f6e332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:58 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Volume 78f3e7bf-177a-47ff-804d-bbc72012e9e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2', 'volume_size': 1}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.601s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.info" returned: 0 in 0.548s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.142s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-672458215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f3e7bf-177a-47ff-804d-bbc72012e9e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08885cd008154a51a10261751ce1489a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:22:58Z,use_quota=True,user_id='725340ec7e6d4c5b8f0ff54ec076f657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Creating volume 78f3e7bf-177a-47ff-804d-bbc72012e9e2 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:22:58 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:58 devstack sudo[86539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2 1073741824
Apr 14 01:22:58 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:58 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Deleted volume successfully.
Apr 14 01:22:58 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-cbe0c67a-e45b-4a50-b9a8-e4227cfde2e0 tempest-CinderUnicodeTest-1540529963 None] Create snapshot completed successfully
Apr 14 01:22:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d09f31b4-9814-4476-89f1-05030619a28a tempest-VolumeSnapshotQuotasNegativeTestJSON-358648591 None] Lock "cinder-ce4bb032-6eda-4611-b0dd-c0d9f6998b5f-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:22:59 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2 1073741824" returned: 0 in 0.528s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:59 devstack sudo[86544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2
Apr 14 01:22:59 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Acquiring lock "cinder-70446f5d-c124-4ace-8ec2-6d4a7d166718-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Lock "cinder-70446f5d-c124-4ace-8ec2-6d4a7d166718-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Acquiring lock "cinder-quobyte-974a93bd-e198-4481-99b8-98c51ef46204" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Lock "cinder-quobyte-974a93bd-e198-4481-99b8-98c51ef46204" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Acquiring lock "cinder-quobyte-70446f5d-c124-4ace-8ec2-6d4a7d166718" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Lock "cinder-quobyte-70446f5d-c124-4ace-8ec2-6d4a7d166718" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Deleting offline snapshot 70446f5d-c124-4ace-8ec2-6d4a7d166718 of volume 974a93bd-e198-4481-99b8-98c51ef46204 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] snapshot_file for this snap is: volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[039578f2-4366-4c23-8140-e10460733a7e]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:22:59 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2" returned: 0 in 0.583s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd36f4e7-ec01-4935-840d-4b9b6f6e332f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4210f8f-3e01-4a02-a1c3-54034c165637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:22:59 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Volume volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2 (78f3e7bf-177a-47ff-804d-bbc72012e9e2): created successfully
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4210f8f-3e01-4a02-a1c3-54034c165637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:22:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Flow 'volume_create_manager' (c757790d-5157-4f57-b5d1-b4c8de6cc61c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:22:59 devstack sudo[86547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718
Apr 14 01:22:59 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:22:59 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b8486c02-9957-4303-8c9a-8455e566cfb3 tempest-VolumesListTestJSON-977467097 None] Created volume successfully.
Apr 14 01:23:00 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718" returned: 0 in 0.611s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-974a93bd-e198-4481-99b8-98c51ef46204(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:23:00 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37d4b60-28cd-41e6-a4b7-691975bdfe5b]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:00 devstack sudo[86552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204
Apr 14 01:23:00 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:00 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204" returned: 0 in 0.656s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:00 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:01 devstack sudo[86557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718
Apr 14 01:23:01 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Flow 'volume_create_manager' (ae509040-b15b-4477-84de-f5317a7d187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff40e3f-b3a0-4dff-b771-4c82ff58e59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff40e3f-b3a0-4dff-b771-4c82ff58e59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-663419108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b566cf78-469d-4f9c-b28f-526c19769644,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08885cd008154a51a10261751ce1489a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:01Z,use_quota=True,user_id='725340ec7e6d4c5b8f0ff54ec076f657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe94c92-188e-4a49-ab4b-3eff550bf5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe94c92-188e-4a49-ab4b-3eff550bf5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71fc817-5fda-4ce2-a271-869950e5e1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71fc817-5fda-4ce2-a271-869950e5e1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b566cf78-469d-4f9c-b28f-526c19769644', 'volume_name': 'volume-b566cf78-469d-4f9c-b28f-526c19769644', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7267c82f-1101-465f-ad6c-a6963dd47c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7267c82f-1101-465f-ad6c-a6963dd47c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f77753-e2ab-448c-98cb-d07c9683c507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:01 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Volume b566cf78-469d-4f9c-b28f-526c19769644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b566cf78-469d-4f9c-b28f-526c19769644', 'volume_size': 1}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-663419108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b566cf78-469d-4f9c-b28f-526c19769644,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08885cd008154a51a10261751ce1489a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:01Z,use_quota=True,user_id='725340ec7e6d4c5b8f0ff54ec076f657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Creating volume b566cf78-469d-4f9c-b28f-526c19769644 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:23:01 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b566cf78-469d-4f9c-b28f-526c19769644 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:01 devstack sudo[86559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b566cf78-469d-4f9c-b28f-526c19769644 1073741824
Apr 14 01:23:01 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:01 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718" returned: 0 in 0.817s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:01 devstack sudo[86583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718
Apr 14 01:23:01 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:01 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b566cf78-469d-4f9c-b28f-526c19769644 1073741824" returned: 0 in 0.756s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b566cf78-469d-4f9c-b28f-526c19769644 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:01 devstack sudo[86585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b566cf78-469d-4f9c-b28f-526c19769644
Apr 14 01:23:01 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:02 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204.70446f5d-c124-4ace-8ec2-6d4a7d166718" returned: 0 in 0.524s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Lock "cinder-quobyte-70446f5d-c124-4ace-8ec2-6d4a7d166718" released by "_delete_snapshot" :: held 2.689s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Lock "cinder-quobyte-974a93bd-e198-4481-99b8-98c51ef46204" released by "delete_snapshot" :: held 2.700s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:02 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b566cf78-469d-4f9c-b28f-526c19769644" returned: 0 in 0.505s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f77753-e2ab-448c-98cb-d07c9683c507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b566cf78-469d-4f9c-b28f-526c19769644', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f534cace-2063-409d-9955-334b67ad3cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:02 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Volume volume-b566cf78-469d-4f9c-b28f-526c19769644 (b566cf78-469d-4f9c-b28f-526c19769644): created successfully
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f534cace-2063-409d-9955-334b67ad3cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Flow 'volume_create_manager' (ae509040-b15b-4477-84de-f5317a7d187a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:02 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-522eb4cd-2021-4083-a988-601a477d7e75 tempest-VolumesListTestJSON-977467097 None] Created volume successfully.
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Created reservations ['827a81a7-cc4b-4caf-b47c-738b237ea61d', 'a7ba76fe-c2be-4a6a-95ab-b9e0aa16a1d4', '2186c27c-3db4-447f-bca0-ce79454fd84b', '859a47dc-2f93-4c28-88f1-41d7700144b9'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:02 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Delete snapshot completed successfully.
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-67e51271-8d2d-473a-9f6c-e916823707fc tempest-CinderUnicodeTest-1540529963 None] Lock "cinder-70446f5d-c124-4ace-8ec2-6d4a7d166718-delete_snapshot" released by "delete_snapshot" :: held 2.830s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Acquiring lock "cinder-974a93bd-e198-4481-99b8-98c51ef46204-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Lock "cinder-974a93bd-e198-4481-99b8-98c51ef46204-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Acquiring lock "cinder-quobyte-974a93bd-e198-4481-99b8-98c51ef46204" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Lock "cinder-quobyte-974a93bd-e198-4481-99b8-98c51ef46204" acquired by "delete_volume" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9a1dbc-1cdc-48f8-9406-ee5bccfc8f9a]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:02 devstack sudo[86589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204
Apr 14 01:23:02 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:03 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204" returned: 0 in 0.525s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:03 devstack sudo[86594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204
Apr 14 01:23:03 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Flow 'volume_create_manager' (cbeb2ae8-7c66-4b35-a1f2-ae213c014020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0a28c8-e7b0-4180-bbec-2926712603fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0a28c8-e7b0-4180-bbec-2926712603fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1667611845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f6fd69-f8aa-4aee-af4b-df7193f40735,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08885cd008154a51a10261751ce1489a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:03Z,use_quota=True,user_id='725340ec7e6d4c5b8f0ff54ec076f657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e20206-96e9-4443-b774-1848fdf94cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e20206-96e9-4443-b774-1848fdf94cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16899c9b-d3d1-4119-bb81-26eedd80fc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16899c9b-d3d1-4119-bb81-26eedd80fc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f6fd69-f8aa-4aee-af4b-df7193f40735', 'volume_name': 'volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53b2095-28bf-4296-a3bd-aa7108d429bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53b2095-28bf-4296-a3bd-aa7108d429bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644b1039-5463-4a64-8dd7-248331599c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:03 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Volume c4f6fd69-f8aa-4aee-af4b-df7193f40735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735', 'volume_size': 1}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1667611845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f6fd69-f8aa-4aee-af4b-df7193f40735,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08885cd008154a51a10261751ce1489a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:03Z,use_quota=True,user_id='725340ec7e6d4c5b8f0ff54ec076f657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Creating volume c4f6fd69-f8aa-4aee-af4b-df7193f40735 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:23:03 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:03 devstack sudo[86596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735 1073741824
Apr 14 01:23:03 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG oslo_service.periodic_task [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81812) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:03 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-974a93bd-e198-4481-99b8-98c51ef46204" returned: 0 in 0.601s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Lock "cinder-quobyte-974a93bd-e198-4481-99b8-98c51ef46204" released by "delete_volume" :: held 1.165s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:04 devstack sudo[86599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:23:04 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Created reservations ['7e2bf1bb-92df-4923-b7ed-601c6bbabfa6', '2410bd7a-dc18-47d2-959c-207a362f65be', '73b4624b-284f-4031-96d4-35ca4f843235', '0cf409c8-627d-4493-a902-c77ae2ff8ce3'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:04 devstack sudo[86601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:23:04 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:04 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735 1073741824" returned: 0 in 0.616s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:04 devstack sudo[86606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735
Apr 14 01:23:04 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:04 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.492s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:23:04 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.579s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:23:04 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Deleted volume successfully.
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-748d12d9-5faa-4663-a6ae-9ebcaa48bcf3 tempest-CinderUnicodeTest-1540529963 None] Lock "cinder-974a93bd-e198-4481-99b8-98c51ef46204-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:04 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735" returned: 0 in 0.521s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644b1039-5463-4a64-8dd7-248331599c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bf0309-64f6-4173-8b5b-74098cae1a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:04 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Volume volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735 (c4f6fd69-f8aa-4aee-af4b-df7193f40735): created successfully
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bf0309-64f6-4173-8b5b-74098cae1a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Flow 'volume_create_manager' (cbeb2ae8-7c66-4b35-a1f2-ae213c014020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:04 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-7aab2742-b4b3-4840-835b-aeb6693f2b62 tempest-VolumesListTestJSON-977467097 None] Created volume successfully.
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Acquiring lock "cinder-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Lock "cinder-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Acquiring lock "cinder-quobyte-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Lock "cinder-quobyte-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7f6d2d-6bfa-47da-9e5c-8de1ec102996]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:05 devstack sudo[86620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3
Apr 14 01:23:05 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:05 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3" returned: 0 in 0.585s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:05 devstack sudo[86625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3
Apr 14 01:23:05 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Flow 'volume_create_manager' (54e8603b-9f36-4e7f-b6c5-ed65be93d6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160b0347-b498-4125-acf1-f180740cc6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160b0347-b498-4125-acf1-f180740cc6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-627150215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc7ded8-51e6-40fd-8bc6-33fadfc23b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c8c6964d4a4456b8ff6c8391d8ac3d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:06Z,use_quota=True,user_id='b65d11ce695646588fb3fa9a0a60f386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6796ceb-6e54-4c90-a5ee-d43557aeb56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6796ceb-6e54-4c90-a5ee-d43557aeb56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1100e4-c49c-4996-ab33-975968ca4375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1100e4-c49c-4996-ab33-975968ca4375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddc7ded8-51e6-40fd-8bc6-33fadfc23b96', 'volume_name': 'volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7feb47-aa8e-41d7-9f37-f557a380093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7feb47-aa8e-41d7-9f37-f557a380093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e147c01-e9c7-4154-9e86-89d3d2bbb2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:05 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Volume ddc7ded8-51e6-40fd-8bc6-33fadfc23b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96', 'volume_size': 1}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-627150215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc7ded8-51e6-40fd-8bc6-33fadfc23b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c8c6964d4a4456b8ff6c8391d8ac3d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:06Z,use_quota=True,user_id='b65d11ce695646588fb3fa9a0a60f386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Creating volume ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:23:05 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:23:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:05 devstack sudo[86627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 1073741824
Apr 14 01:23:05 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:06 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3" returned: 0 in 0.551s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Lock "cinder-quobyte-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3" released by "delete_volume" :: held 1.182s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:06 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Created reservations ['c60b89eb-8e05-46e8-961c-85bf5fcd6007', 'f44ea739-c858-49c9-9e3c-babd6b3dd720', '09d14822-a6a7-4c8c-bc8d-bb54ec8861c5', '0a589bce-fcfd-49d6-b418-437ee21e733c'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:06 devstack sudo[86633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:23:06 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:06 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 1073741824" returned: 0 in 0.581s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:06 devstack sudo[86635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96
Apr 14 01:23:06 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:06 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.630s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:06 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:23:06 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Deleted volume successfully.
Apr 14 01:23:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-27baedd2-6ce7-4cce-a62e-02487f1a0875 tempest-CinderUnicodeTest-1540529963 None] Lock "cinder-b2f9d7db-ae7d-48bd-b653-39fa3c6aa4b3-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:07 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96" returned: 0 in 0.674s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:23:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e147c01-e9c7-4154-9e86-89d3d2bbb2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecdb9041-6711-499c-9264-b12598184343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:07 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Volume volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 (ddc7ded8-51e6-40fd-8bc6-33fadfc23b96): created successfully
Apr 14 01:23:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecdb9041-6711-499c-9264-b12598184343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Flow 'volume_create_manager' (54e8603b-9f36-4e7f-b6c5-ed65be93d6f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:07 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-a0cfe9e3-7415-4d17-8325-e8a71d9013ab tempest-SnapshotMetadataTestJSON-1486364817 None] Created volume successfully.
Apr 14 01:23:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Acquiring lock "cinder-c4f6fd69-f8aa-4aee-af4b-df7193f40735-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Lock "cinder-c4f6fd69-f8aa-4aee-af4b-df7193f40735-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Acquiring lock "cinder-quobyte-c4f6fd69-f8aa-4aee-af4b-df7193f40735" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Lock "cinder-quobyte-c4f6fd69-f8aa-4aee-af4b-df7193f40735" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:07 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[69336e36-01c5-4633-b8d9-18f37a6c4cd1]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:07 devstack sudo[86668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735
Apr 14 01:23:07 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] Creating offline snapshot a617f7e1-0786-42e7-a4da-5eeeaba5e491 of volume ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:23:08 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8edc62a-e310-4b4f-a021-612a3a0f3a96]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:08 devstack sudo[86670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96
Apr 14 01:23:08 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:08 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735" returned: 0 in 0.768s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:08 devstack sudo[86675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735
Apr 14 01:23:08 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:08 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96" returned: 0 in 0.746s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:08 devstack sudo[86680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491 1G
Apr 14 01:23:08 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:09 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c4f6fd69-f8aa-4aee-af4b-df7193f40735" returned: 0 in 0.705s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Lock "cinder-quobyte-c4f6fd69-f8aa-4aee-af4b-df7193f40735" released by "delete_volume" :: held 1.508s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Created reservations ['0612cac7-313f-40ef-a1a3-9b0dea561e3f', 'ec807486-cc61-4e3a-be1b-be8c9896b6cd', 'bb5ee559-86a5-4a22-9524-c86758c66947', 'a91456b2-e1cf-4fa2-9f51-7f2e1ca57593'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:09 devstack sudo[86686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:23:09 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:09 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491 1G" returned: 0 in 0.580s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:09 devstack sudo[86689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491
Apr 14 01:23:09 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:09 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.522s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:23:09 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Deleted volume successfully.
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c81d54ee-a072-492a-b04e-56a2cecc9335 tempest-VolumesListTestJSON-977467097 None] Lock "cinder-c4f6fd69-f8aa-4aee-af4b-df7193f40735-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Acquiring lock "cinder-b566cf78-469d-4f9c-b28f-526c19769644-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Lock "cinder-b566cf78-469d-4f9c-b28f-526c19769644-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Acquiring lock "cinder-quobyte-b566cf78-469d-4f9c-b28f-526c19769644" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Lock "cinder-quobyte-b566cf78-469d-4f9c-b28f-526c19769644" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc48fcac-9637-4384-b5aa-165610644a5a]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b566cf78-469d-4f9c-b28f-526c19769644 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:10 devstack sudo[86694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b566cf78-469d-4f9c-b28f-526c19769644
Apr 14 01:23:10 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:10 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491" returned: 0 in 0.679s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:10 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491 is being set with open permissions: ugo+rw
Apr 14 01:23:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:10 devstack sudo[86699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491
Apr 14 01:23:10 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:10 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b566cf78-469d-4f9c-b28f-526c19769644" returned: 0 in 0.607s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b566cf78-469d-4f9c-b28f-526c19769644 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:10 devstack sudo[86705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b566cf78-469d-4f9c-b28f-526c19769644
Apr 14 01:23:10 devstack sudo[86705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:10 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491" returned: 0 in 0.454s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:10 devstack sudo[86707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.info
Apr 14 01:23:10 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:11 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.info" returned: 0 in 0.471s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:11 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.info is being set with open permissions: ugo+rw
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:11 devstack sudo[86711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.info
Apr 14 01:23:11 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:11 devstack sudo[86705]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b566cf78-469d-4f9c-b28f-526c19769644" returned: 0 in 0.572s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Lock "cinder-quobyte-b566cf78-469d-4f9c-b28f-526c19769644" released by "delete_volume" :: held 1.209s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Created reservations ['5fa70355-17c6-446a-bcc0-c7a8a68a3037', '64dcb4e1-39cb-4d4f-8adb-365dee203345', '42865a2f-2f9c-4b11-ad1a-d9b4752f1d70', '1f987caf-d699-4bea-b177-5687fe11bdcb'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:11 devstack sudo[86713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:23:11 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:11 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.info" returned: 0 in 0.482s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.494s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:11 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8a61f733-ce6f-4c28-9abe-70ebde113120 tempest-SnapshotMetadataTestJSON-1486364817 None] Create snapshot completed successfully
Apr 14 01:23:11 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.442s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:23:11 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Deleted volume successfully.
Apr 14 01:23:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b2d66d1b-9dd8-4e9c-9e6c-5d70c64a1ebc tempest-VolumesListTestJSON-977467097 None] Lock "cinder-b566cf78-469d-4f9c-b28f-526c19769644-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Acquiring lock "cinder-78f3e7bf-177a-47ff-804d-bbc72012e9e2-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Lock "cinder-78f3e7bf-177a-47ff-804d-bbc72012e9e2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Acquiring lock "cinder-quobyte-78f3e7bf-177a-47ff-804d-bbc72012e9e2" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Lock "cinder-quobyte-78f3e7bf-177a-47ff-804d-bbc72012e9e2" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a051f389-bf84-426f-8b5c-654bbb7c22c7]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:12 devstack sudo[86717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2
Apr 14 01:23:12 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:12 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2" returned: 0 in 0.555s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:12 devstack sudo[86722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2
Apr 14 01:23:12 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Acquiring lock "cinder-a617f7e1-0786-42e7-a4da-5eeeaba5e491-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "cinder-a617f7e1-0786-42e7-a4da-5eeeaba5e491-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Acquiring lock "cinder-quobyte-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "cinder-quobyte-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Acquiring lock "cinder-quobyte-a617f7e1-0786-42e7-a4da-5eeeaba5e491" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "cinder-quobyte-a617f7e1-0786-42e7-a4da-5eeeaba5e491" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Deleting offline snapshot a617f7e1-0786-42e7-a4da-5eeeaba5e491 of volume ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] snapshot_file for this snap is: volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[78657482-5788-4dfa-ad7d-08d4a69b5728]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:12 devstack sudo[86724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491
Apr 14 01:23:12 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:13 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-78f3e7bf-177a-47ff-804d-bbc72012e9e2" returned: 0 in 0.460s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Lock "cinder-quobyte-78f3e7bf-177a-47ff-804d-bbc72012e9e2" released by "delete_volume" :: held 1.043s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Created reservations ['4a7890c1-0af4-4492-9731-dbb91409329d', '66bf5670-e438-432b-b8a2-38ac9ad2753b', '1acca187-36f4-4a06-9e01-ec586d767e07', '147f98f8-042f-4cd6-a506-08181008a646'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:13 devstack sudo[86759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:23:13 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:13 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491" returned: 0 in 0.667s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e32bda-23a0-43c5-b9e1-a872eea78e52]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:13 devstack sudo[86766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96
Apr 14 01:23:13 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:13 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.467s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:23:13 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Deleted volume successfully.
Apr 14 01:23:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-66009a06-303f-47e7-8352-18acfda45327 tempest-VolumesListTestJSON-977467097 None] Lock "cinder-78f3e7bf-177a-47ff-804d-bbc72012e9e2-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:14 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96" returned: 0 in 0.576s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:14 devstack sudo[86772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491
Apr 14 01:23:14 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:14 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491" returned: 0 in 0.661s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:14 devstack sudo[86777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491
Apr 14 01:23:14 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:15 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96.a617f7e1-0786-42e7-a4da-5eeeaba5e491" returned: 0 in 0.807s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "cinder-quobyte-a617f7e1-0786-42e7-a4da-5eeeaba5e491" released by "_delete_snapshot" :: held 2.802s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "cinder-quobyte-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96" released by "delete_snapshot" :: held 2.827s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:15 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Created reservations ['44fe5033-5ecf-444a-b77b-d89969ca49dc', '5f58cf08-4a42-4476-8ea0-d14d61f8f99c', '244c17fa-6a8f-4a0a-be0e-0df59028817d', '347b9da6-1451-4c70-882d-3c54d45c7317'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:15 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Delete snapshot completed successfully.
Apr 14 01:23:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9754cf12-33c7-4724-963b-8f701eb7e9c4 tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "cinder-a617f7e1-0786-42e7-a4da-5eeeaba5e491-delete_snapshot" released by "delete_snapshot" :: held 2.924s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Acquiring lock "cinder-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "cinder-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Acquiring lock "cinder-quobyte-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "cinder-quobyte-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96" acquired by "delete_volume" :: waited 0.017s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:16 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d1c423-6260-4d8f-9b3c-fe4fa4b70f20]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:16 devstack sudo[86791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96
Apr 14 01:23:16 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:16 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96" returned: 0 in 0.688s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:16 devstack sudo[86801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96
Apr 14 01:23:16 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:17 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96" returned: 0 in 0.561s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "cinder-quobyte-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96" released by "delete_volume" :: held 1.315s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:17 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Created reservations ['a17e6253-d317-46c9-a950-1ea967cd5d79', '42b4268e-1ae6-41a3-b073-332bad6c4d8a', 'f1d32854-bb5b-484b-9454-3bde9766ae63', '68157300-5258-469c-b464-5e7fa75d97c6'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:17 devstack sudo[86805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:23:17 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:18 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.442s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:18 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:23:18 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Deleted volume successfully.
Apr 14 01:23:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9d34e84c-1689-4f22-bfb2-d8fd021cc1b1 tempest-SnapshotMetadataTestJSON-1486364817 None] Lock "cinder-ddc7ded8-51e6-40fd-8bc6-33fadfc23b96-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Flow 'volume_create_manager' (cc3e6ed0-ac28-4539-9e3e-26923e3ae695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7b8037-3952-4307-8d76-1f908cd7b951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7b8037-3952-4307-8d76-1f908cd7b951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1548976256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fde4837-c730-4861-a04d-4ea9cf47eb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1c93dc94c54774b608eef1d526177e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:22Z,use_quota=True,user_id='89dc6a5484fc4121b55d3a6b7f921276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a190bb0c-ab72-4ff3-813a-d9065c7e2aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a190bb0c-ab72-4ff3-813a-d9065c7e2aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be95ce80-6ce9-49c2-bed2-8e65969fc4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be95ce80-6ce9-49c2-bed2-8e65969fc4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fde4837-c730-4861-a04d-4ea9cf47eb7d', 'volume_name': 'volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f52a05-6676-4108-acf9-836a1bc02550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f52a05-6676-4108-acf9-836a1bc02550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed7382e-5455-4f11-9a32-b760bc38f125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:21 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Volume 8fde4837-c730-4861-a04d-4ea9cf47eb7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d', 'volume_size': 1}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1548976256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fde4837-c730-4861-a04d-4ea9cf47eb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1c93dc94c54774b608eef1d526177e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:22Z,use_quota=True,user_id='89dc6a5484fc4121b55d3a6b7f921276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Creating volume 8fde4837-c730-4861-a04d-4ea9cf47eb7d {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:23:21 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:23:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:21 devstack sudo[86838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d 1073741824
Apr 14 01:23:21 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:23 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d 1073741824" returned: 0 in 1.431s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:23 devstack sudo[86843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d
Apr 14 01:23:23 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:24 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d" returned: 0 in 1.037s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] <== create_volume: return (2538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.543s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed7382e-5455-4f11-9a32-b760bc38f125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bca078-f121-45b4-bbe4-6c3ac5dc7147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Flow 'volume_create_manager' (e57ca89d-8b5e-4d6a-afe2-e7ac3add3399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0a592c-8bc7-49e2-9631-c4d2f2cbe936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:24 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Volume volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d (8fde4837-c730-4861-a04d-4ea9cf47eb7d): created successfully
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bca078-f121-45b4-bbe4-6c3ac5dc7147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Flow 'volume_create_manager' (cc3e6ed0-ac28-4539-9e3e-26923e3ae695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0a592c-8bc7-49e2-9631-c4d2f2cbe936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1228396678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4b1c9c-3843-4310-b6c0-f18c20da7980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9716d5f97f264338bfe005d461e9f852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:24Z,use_quota=True,user_id='4b87f6d81d4d47fe884579b8a8cb15eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97de065-d3dd-4598-bf3e-d117b984ee7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97de065-d3dd-4598-bf3e-d117b984ee7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f74b7d-f7e0-4946-b9d7-99cbee556e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f74b7d-f7e0-4946-b9d7-99cbee556e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a4b1c9c-3843-4310-b6c0-f18c20da7980', 'volume_name': 'volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9261ad-1a99-4bbe-a469-200be1ed7d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9261ad-1a99-4bbe-a469-200be1ed7d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e0eca8-76de-41ac-b192-4c21bea2add5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:24 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Volume 6a4b1c9c-3843-4310-b6c0-f18c20da7980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980', 'volume_size': 1}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1228396678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4b1c9c-3843-4310-b6c0-f18c20da7980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9716d5f97f264338bfe005d461e9f852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:24Z,use_quota=True,user_id='4b87f6d81d4d47fe884579b8a8cb15eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Creating volume 6a4b1c9c-3843-4310-b6c0-f18c20da7980 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:23:24 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:24 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c164eb1c-342f-4cd4-9a7f-e570e6f0ba8d tempest-AbsoluteLimitsTests-1471435795 None] Created volume successfully.
Apr 14 01:23:24 devstack sudo[86846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980 1073741824
Apr 14 01:23:24 devstack sudo[86846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:24 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Acquiring lock "cinder-8fde4837-c730-4861-a04d-4ea9cf47eb7d-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Lock "cinder-8fde4837-c730-4861-a04d-4ea9cf47eb7d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Acquiring lock "cinder-quobyte-8fde4837-c730-4861-a04d-4ea9cf47eb7d" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Lock "cinder-quobyte-8fde4837-c730-4861-a04d-4ea9cf47eb7d" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8870002-48a7-4cc3-93d7-447b6f569b77]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:25 devstack sudo[86852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d
Apr 14 01:23:25 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:25 devstack sudo[86846]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980 1073741824" returned: 0 in 0.740s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:25 devstack sudo[86877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980
Apr 14 01:23:25 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:25 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d" returned: 0 in 0.618s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:25 devstack sudo[86887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d
Apr 14 01:23:25 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:25 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980" returned: 0 in 0.513s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e0eca8-76de-41ac-b192-4c21bea2add5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f13578a-3883-4cb7-bab1-0b7e4ddcd106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:25 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Volume volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980 (6a4b1c9c-3843-4310-b6c0-f18c20da7980): created successfully
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f13578a-3883-4cb7-bab1-0b7e4ddcd106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:25 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Flow 'volume_create_manager' (e57ca89d-8b5e-4d6a-afe2-e7ac3add3399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:25 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f5d10b4f-802f-4f7a-9395-d97f4cc9a4b8 tempest-VolumesSnapshotTestJSON-869685304 None] Created volume successfully.
Apr 14 01:23:26 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8fde4837-c730-4861-a04d-4ea9cf47eb7d" returned: 0 in 0.444s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Lock "cinder-quobyte-8fde4837-c730-4861-a04d-4ea9cf47eb7d" released by "delete_volume" :: held 1.098s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Created reservations ['9cad2b25-7d1d-45b2-85be-569cd3a5bbc4', '9bd76a1d-7181-467a-a74f-6ea828f37209', '757b1b3c-ed4e-4570-bd37-3ffa41798ddf', '33ca11cc-377a-41e8-a42d-d1777e9e8108'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:26 devstack sudo[86891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:23:26 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] Creating offline snapshot f7ea7210-5054-4ecc-83e5-1f5b18b5e64c of volume 6a4b1c9c-3843-4310-b6c0-f18c20da7980 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2f71c3-31cb-4a07-a710-857ccaec1290]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:26 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.532s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:23:26 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Deleted volume successfully.
Apr 14 01:23:26 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d00b5374-d1cb-4798-8213-677497b67440 tempest-AbsoluteLimitsTests-1471435795 None] Lock "cinder-8fde4837-c730-4861-a04d-4ea9cf47eb7d-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:26 devstack sudo[86894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980
Apr 14 01:23:26 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:27 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980" returned: 0 in 0.625s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:27 devstack sudo[86900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c 1G
Apr 14 01:23:27 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:27 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c 1G" returned: 0 in 0.649s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:27 devstack sudo[86907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c
Apr 14 01:23:27 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:28 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c" returned: 0 in 0.731s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:28 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c is being set with open permissions: ugo+rw
Apr 14 01:23:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:28 devstack sudo[86917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c
Apr 14 01:23:28 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:29 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c" returned: 0 in 0.543s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:29 devstack sudo[86922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.info
Apr 14 01:23:29 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:29 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.info" returned: 0 in 0.524s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:29 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.info is being set with open permissions: ugo+rw
Apr 14 01:23:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:29 devstack sudo[86925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.info
Apr 14 01:23:29 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:30 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.info" returned: 0 in 0.595s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.741s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:30 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-32b4ce76-bbbc-497a-a31d-31168f10f5c4 tempest-VolumesSnapshotTestJSON-869685304 None] Create snapshot completed successfully
Apr 14 01:23:30 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Flow 'volume_create_manager' (23fcdcbd-2e1a-4663-870e-75b37e990ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459616ef-9a22-42fc-966b-5a59f1efe86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459616ef-9a22-42fc-966b-5a59f1efe86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-450841758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a52926-0aeb-4af3-9e65-3923b3000da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc045c2461e4bbca753c6f79fc2e499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:31Z,use_quota=True,user_id='d90c06fd98d94ca590bba66925838654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39315fa-0b02-4546-aa0e-27388d0217e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39315fa-0b02-4546-aa0e-27388d0217e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc3334d-2372-46a4-bb1a-a2a1e9f5d234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc3334d-2372-46a4-bb1a-a2a1e9f5d234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a52926-0aeb-4af3-9e65-3923b3000da3', 'volume_name': 'volume-00a52926-0aeb-4af3-9e65-3923b3000da3', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683fef51-0b54-4837-91c8-ad3db65b3275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683fef51-0b54-4837-91c8-ad3db65b3275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a32da0-0b51-4227-95df-a04f7aade3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:31 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Volume 00a52926-0aeb-4af3-9e65-3923b3000da3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a52926-0aeb-4af3-9e65-3923b3000da3', 'volume_size': 1}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-450841758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a52926-0aeb-4af3-9e65-3923b3000da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc045c2461e4bbca753c6f79fc2e499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:31Z,use_quota=True,user_id='d90c06fd98d94ca590bba66925838654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Creating volume 00a52926-0aeb-4af3-9e65-3923b3000da3 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:23:31 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00a52926-0aeb-4af3-9e65-3923b3000da3 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-f7ea7210-5054-4ecc-83e5-1f5b18b5e64c-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-f7ea7210-5054-4ecc-83e5-1f5b18b5e64c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:31 devstack sudo[86928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00a52926-0aeb-4af3-9e65-3923b3000da3 1073741824
Apr 14 01:23:31 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-6a4b1c9c-3843-4310-b6c0-f18c20da7980" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-6a4b1c9c-3843-4310-b6c0-f18c20da7980" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-f7ea7210-5054-4ecc-83e5-1f5b18b5e64c" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-f7ea7210-5054-4ecc-83e5-1f5b18b5e64c" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Deleting offline snapshot f7ea7210-5054-4ecc-83e5-1f5b18b5e64c of volume 6a4b1c9c-3843-4310-b6c0-f18c20da7980 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] snapshot_file for this snap is: volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d03b543-078b-4b9a-8ed0-f908174fd410]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:31 devstack sudo[86930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c
Apr 14 01:23:31 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:31 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00a52926-0aeb-4af3-9e65-3923b3000da3 1073741824" returned: 0 in 0.644s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:31 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c" returned: 0 in 0.585s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e959da6-ae7e-4867-89f7-6a74846fdc56]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00a52926-0aeb-4af3-9e65-3923b3000da3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:31 devstack sudo[86939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00a52926-0aeb-4af3-9e65-3923b3000da3
Apr 14 01:23:31 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Flow 'volume_create_manager' (b9064464-2697-4241-9b05-2d02430cb4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f69e882-7666-4225-8867-1edd21b62cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:31 devstack sudo[86938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980
Apr 14 01:23:31 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f69e882-7666-4225-8867-1edd21b62cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-154626463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e6c687-fa7a-41fe-8e49-e3cb126cb689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984f9200704465c99be42f3330fcbb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:32Z,use_quota=True,user_id='87077d08d3f641b2835bf7f70660c4e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc92eace-0874-4ed7-bbd8-e8250b084dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc92eace-0874-4ed7-bbd8-e8250b084dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f04350b-c271-40aa-8fc9-b08bc8ba430d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f04350b-c271-40aa-8fc9-b08bc8ba430d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e6c687-fa7a-41fe-8e49-e3cb126cb689', 'volume_name': 'volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6501e6-ce31-49bb-b04c-42ef72dc5126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6501e6-ce31-49bb-b04c-42ef72dc5126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53815823-2f74-4e42-88d5-537e02b694c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:31 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Volume a2e6c687-fa7a-41fe-8e49-e3cb126cb689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689', 'volume_size': 1}
Apr 14 01:23:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:32 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00a52926-0aeb-4af3-9e65-3923b3000da3" returned: 0 in 0.443s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.345s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-154626463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e6c687-fa7a-41fe-8e49-e3cb126cb689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984f9200704465c99be42f3330fcbb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:32Z,use_quota=True,user_id='87077d08d3f641b2835bf7f70660c4e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Creating volume a2e6c687-fa7a-41fe-8e49-e3cb126cb689 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:23:32 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a32da0-0b51-4227-95df-a04f7aade3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a52926-0aeb-4af3-9e65-3923b3000da3', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:32 devstack sudo[86946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689 1073741824
Apr 14 01:23:32 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48c30ba-8ed2-4dd3-a940-ee55ae8ce677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:32 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Volume volume-00a52926-0aeb-4af3-9e65-3923b3000da3 (00a52926-0aeb-4af3-9e65-3923b3000da3): created successfully
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48c30ba-8ed2-4dd3-a940-ee55ae8ce677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Flow 'volume_create_manager' (23fcdcbd-2e1a-4663-870e-75b37e990ff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:32 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e6938ad4-1e1f-411a-852d-585ffdfa392e tempest-VolumesTransfersTest-1574507119 None] Created volume successfully.
Apr 14 01:23:32 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980" returned: 0 in 0.539s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:32 devstack sudo[86948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c
Apr 14 01:23:32 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:32 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689 1073741824" returned: 0 in 0.469s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:32 devstack sudo[86956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689
Apr 14 01:23:32 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:32 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c" returned: 0 in 0.502s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:32 devstack sudo[86958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c
Apr 14 01:23:32 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:33 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689" returned: 0 in 0.457s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:23:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53815823-2f74-4e42-88d5-537e02b694c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236fec8e-3510-4e8d-918b-096e94f6e667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:33 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Volume volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689 (a2e6c687-fa7a-41fe-8e49-e3cb126cb689): created successfully
Apr 14 01:23:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236fec8e-3510-4e8d-918b-096e94f6e667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:33 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Flow 'volume_create_manager' (b9064464-2697-4241-9b05-2d02430cb4d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980.f7ea7210-5054-4ecc-83e5-1f5b18b5e64c" returned: 0 in 0.416s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:33 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-93aa143a-918a-4277-92c4-3d22c201bc09 tempest-ServersNegativeTestJSON-94018543 None] Created volume successfully.
Apr 14 01:23:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-f7ea7210-5054-4ecc-83e5-1f5b18b5e64c" released by "_delete_snapshot" :: held 2.135s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-6a4b1c9c-3843-4310-b6c0-f18c20da7980" released by "delete_snapshot" :: held 2.146s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:33 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Created reservations ['28a7f327-df85-47f4-9eb3-37a96fb506ff', '66b3eccb-4a81-43c1-ac72-8782648a3d11', 'e046a5bd-b3e4-43ae-9225-9b438c9016a1', '240358cc-eeeb-4198-a0e3-6d0f9df5ed5d'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:33 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Delete snapshot completed successfully.
Apr 14 01:23:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-358272e7-5e95-4d90-8d8f-5c52eccf4c60 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-f7ea7210-5054-4ecc-83e5-1f5b18b5e64c-delete_snapshot" released by "delete_snapshot" :: held 2.245s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:33 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-1bf08c9c-27ff-4f1c-8e5f-14e1afa5e016 tempest-VolumesTransfersTest-914185526 None] Transfer volume completed successfully.
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Acquiring lock "cinder-00a52926-0aeb-4af3-9e65-3923b3000da3-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Lock "cinder-00a52926-0aeb-4af3-9e65-3923b3000da3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Acquiring lock "cinder-quobyte-00a52926-0aeb-4af3-9e65-3923b3000da3" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Lock "cinder-quobyte-00a52926-0aeb-4af3-9e65-3923b3000da3" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0beabe3-7b73-458b-b857-5a5db395337d]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00a52926-0aeb-4af3-9e65-3923b3000da3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:34 devstack sudo[86962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00a52926-0aeb-4af3-9e65-3923b3000da3
Apr 14 01:23:34 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Flow 'volume_create_manager' (58c9adf4-d9c6-4fc8-bae0-56113b0311ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a871710-7412-4204-b475-19f89adb4538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a871710-7412-4204-b475-19f89adb4538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-961267917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2428d4d-4a20-4bdd-ad42-92ca8a20d949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9716d5f97f264338bfe005d461e9f852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:35Z,use_quota=True,user_id='4b87f6d81d4d47fe884579b8a8cb15eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c4dfc5-c96a-4eea-b86a-20aadd0054bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c4dfc5-c96a-4eea-b86a-20aadd0054bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9e53b4-d867-478e-a72d-188ca73871ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9e53b4-d867-478e-a72d-188ca73871ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2428d4d-4a20-4bdd-ad42-92ca8a20d949', 'volume_name': 'volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf3fe28-c933-49d8-9348-4693e8eef9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf3fe28-c933-49d8-9348-4693e8eef9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279b09f0-8dac-4f99-928b-93a4caac7970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:34 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Volume b2428d4d-4a20-4bdd-ad42-92ca8a20d949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949', 'volume_size': 1}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-961267917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2428d4d-4a20-4bdd-ad42-92ca8a20d949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9716d5f97f264338bfe005d461e9f852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:35Z,use_quota=True,user_id='4b87f6d81d4d47fe884579b8a8cb15eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Creating volume b2428d4d-4a20-4bdd-ad42-92ca8a20d949 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:23:34 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:34 devstack sudo[86966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 1073741824
Apr 14 01:23:34 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Flow 'volume_create_manager' (2338a8c0-1036-4ad4-b25b-50afe2350e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946ba7f7-d1b9-4d94-8a5e-c239df48eee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946ba7f7-d1b9-4d94-8a5e-c239df48eee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-563427653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e08040b-ea0c-4977-a4bd-258b35649ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984f9200704465c99be42f3330fcbb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:35Z,use_quota=True,user_id='87077d08d3f641b2835bf7f70660c4e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8119b353-740c-439e-8790-37bb13306ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8119b353-740c-439e-8790-37bb13306ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0ee530-e1a5-4837-a993-e248e1a52f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0ee530-e1a5-4837-a993-e248e1a52f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e08040b-ea0c-4977-a4bd-258b35649ff2', 'volume_name': 'volume-7e08040b-ea0c-4977-a4bd-258b35649ff2', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574bc41a-f147-40b1-bf8d-3e4abf2756ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574bc41a-f147-40b1-bf8d-3e4abf2756ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a6d1c9-f732-4d5d-a8e0-fa177da56b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:34 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Volume 7e08040b-ea0c-4977-a4bd-258b35649ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e08040b-ea0c-4977-a4bd-258b35649ff2', 'volume_size': 1}
Apr 14 01:23:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:35 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00a52926-0aeb-4af3-9e65-3923b3000da3" returned: 0 in 0.530s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00a52926-0aeb-4af3-9e65-3923b3000da3 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:35 devstack sudo[86971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00a52926-0aeb-4af3-9e65-3923b3000da3
Apr 14 01:23:35 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:35 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 1073741824" returned: 0 in 0.584s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:35 devstack sudo[86976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949
Apr 14 01:23:35 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:35 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-00a52926-0aeb-4af3-9e65-3923b3000da3" returned: 0 in 0.473s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Lock "cinder-quobyte-00a52926-0aeb-4af3-9e65-3923b3000da3" released by "delete_volume" :: held 1.096s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Created reservations ['30f95a30-8db9-414b-ab5a-5eac7de101ba', '2d720710-b247-4c10-a0c5-5a689a9c5575', '7cc2bb48-aa19-4cad-ba23-ace04c0726c4', '358761e9-72bd-4ec6-ba3a-1ee11ad0cb5d'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:35 devstack sudo[86979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:23:35 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:35 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949" returned: 0 in 0.467s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.765s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-563427653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e08040b-ea0c-4977-a4bd-258b35649ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984f9200704465c99be42f3330fcbb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:35Z,use_quota=True,user_id='87077d08d3f641b2835bf7f70660c4e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Creating volume 7e08040b-ea0c-4977-a4bd-258b35649ff2 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:23:35 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7e08040b-ea0c-4977-a4bd-258b35649ff2 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279b09f0-8dac-4f99-928b-93a4caac7970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e67111-8a90-4d6e-80c2-4d061bac8c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:35 devstack sudo[86982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7e08040b-ea0c-4977-a4bd-258b35649ff2 1073741824
Apr 14 01:23:35 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:35 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Volume volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 (b2428d4d-4a20-4bdd-ad42-92ca8a20d949): created successfully
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e67111-8a90-4d6e-80c2-4d061bac8c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Flow 'volume_create_manager' (58c9adf4-d9c6-4fc8-bae0-56113b0311ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:35 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8055e852-59f5-49cd-b69c-f15df86e47d3 tempest-VolumesSnapshotTestJSON-869685304 None] Created volume successfully.
Apr 14 01:23:36 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.459s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:23:36 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Deleted volume successfully.
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d68e7d88-96a4-41d2-b792-0c94356cd733 tempest-VolumesTransfersTest-1663288508 None] Lock "cinder-00a52926-0aeb-4af3-9e65-3923b3000da3-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:36 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7e08040b-ea0c-4977-a4bd-258b35649ff2 1073741824" returned: 0 in 0.505s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7e08040b-ea0c-4977-a4bd-258b35649ff2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:36 devstack sudo[86988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7e08040b-ea0c-4977-a4bd-258b35649ff2
Apr 14 01:23:36 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:36 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7e08040b-ea0c-4977-a4bd-258b35649ff2" returned: 0 in 0.482s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.017s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] Creating offline snapshot 69580516-9351-40ce-96f1-b418df0b137b of volume b2428d4d-4a20-4bdd-ad42-92ca8a20d949 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a6d1c9-f732-4d5d-a8e0-fa177da56b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e08040b-ea0c-4977-a4bd-258b35649ff2', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24aeeef9-7f3d-4747-94de-e58330fa9574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[79513367-7d03-4843-b712-9d4068cc21f9]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:36 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Volume volume-7e08040b-ea0c-4977-a4bd-258b35649ff2 (7e08040b-ea0c-4977-a4bd-258b35649ff2): created successfully
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24aeeef9-7f3d-4747-94de-e58330fa9574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Flow 'volume_create_manager' (2338a8c0-1036-4ad4-b25b-50afe2350e27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:36 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-0fd1e517-d27c-4d5e-8ade-7311e4d56956 tempest-ServersNegativeTestJSON-94018543 None] Created volume successfully.
Apr 14 01:23:36 devstack sudo[86991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949
Apr 14 01:23:36 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Flow 'volume_create_manager' (f04f88b7-0c52-407e-873b-e7e8a75b1b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0d6774-c24e-41ec-aa02-e0df159fd47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0d6774-c24e-41ec-aa02-e0df159fd47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-38709119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5924911a-8d97-4e6e-af20-20c4d29406d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc045c2461e4bbca753c6f79fc2e499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:37Z,use_quota=True,user_id='d90c06fd98d94ca590bba66925838654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa100f42-5141-4a06-9dbc-da8ae6c3ecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa100f42-5141-4a06-9dbc-da8ae6c3ecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fde279-a30c-4f9d-ab63-7fc55a369d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fde279-a30c-4f9d-ab63-7fc55a369d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5924911a-8d97-4e6e-af20-20c4d29406d9', 'volume_name': 'volume-5924911a-8d97-4e6e-af20-20c4d29406d9', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fc86bf-1751-4e88-a886-d36e4eb1ede3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fc86bf-1751-4e88-a886-d36e4eb1ede3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd5b886-3b2a-4f84-a357-f70661d327cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:36 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Volume 5924911a-8d97-4e6e-af20-20c4d29406d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5924911a-8d97-4e6e-af20-20c4d29406d9', 'volume_size': 1}
Apr 14 01:23:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Acquiring lock "cinder-7e08040b-ea0c-4977-a4bd-258b35649ff2-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Lock "cinder-7e08040b-ea0c-4977-a4bd-258b35649ff2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Acquiring lock "cinder-quobyte-7e08040b-ea0c-4977-a4bd-258b35649ff2" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Lock "cinder-quobyte-7e08040b-ea0c-4977-a4bd-258b35649ff2" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:37 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949" returned: 0 in 0.555s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:37 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f14c7a-c108-4747-8065-3af90c31c11a]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7e08040b-ea0c-4977-a4bd-258b35649ff2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:37 devstack sudo[86997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b 1G
Apr 14 01:23:37 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:37 devstack sudo[86998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7e08040b-ea0c-4977-a4bd-258b35649ff2
Apr 14 01:23:37 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:37 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b 1G" returned: 0 in 0.503s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:37 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7e08040b-ea0c-4977-a4bd-258b35649ff2" returned: 0 in 0.503s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7e08040b-ea0c-4977-a4bd-258b35649ff2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:37 devstack sudo[87007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b
Apr 14 01:23:37 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:37 devstack sudo[87008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7e08040b-ea0c-4977-a4bd-258b35649ff2
Apr 14 01:23:37 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:38 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7e08040b-ea0c-4977-a4bd-258b35649ff2" returned: 0 in 0.425s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Lock "cinder-quobyte-7e08040b-ea0c-4977-a4bd-258b35649ff2" released by "delete_volume" :: held 0.971s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:38 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b" returned: 0 in 0.461s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:38 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b is being set with open permissions: ugo+rw
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:38 devstack sudo[87015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b
Apr 14 01:23:38 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Created reservations ['802aabe8-0a09-4ab2-a08f-9e3d1eb8a022', '9458853b-0d9b-4567-857a-4426c1366f34', 'bdacc684-be73-402e-b139-1ddcb5bb7169', '79325e0a-688a-481f-95fa-ba500918a770'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:38 devstack sudo[87017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:23:38 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:38 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b" returned: 0 in 0.423s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:38 devstack sudo[87020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.info
Apr 14 01:23:38 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:38 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.438s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:23:38 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Deleted volume successfully.
Apr 14 01:23:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e740b047-5c59-4f7c-a210-ac9069d423d9 tempest-ServersNegativeTestJSON-94018543 None] Lock "cinder-7e08040b-ea0c-4977-a4bd-258b35649ff2-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:39 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.info" returned: 0 in 0.451s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:39 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.info is being set with open permissions: ugo+rw
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:39 devstack sudo[87024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.info
Apr 14 01:23:39 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Acquiring lock "cinder-a2e6c687-fa7a-41fe-8e49-e3cb126cb689-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Lock "cinder-a2e6c687-fa7a-41fe-8e49-e3cb126cb689-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Acquiring lock "cinder-quobyte-a2e6c687-fa7a-41fe-8e49-e3cb126cb689" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Lock "cinder-quobyte-a2e6c687-fa7a-41fe-8e49-e3cb126cb689" acquired by "delete_volume" :: waited 0.020s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaad46d-2092-4a64-900b-cb18b057bbf7]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:39 devstack sudo[87026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689
Apr 14 01:23:39 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:39 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.info" returned: 0 in 0.415s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.877s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.667s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-38709119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5924911a-8d97-4e6e-af20-20c4d29406d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc045c2461e4bbca753c6f79fc2e499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:37Z,use_quota=True,user_id='d90c06fd98d94ca590bba66925838654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Creating volume 5924911a-8d97-4e6e-af20-20c4d29406d9 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:23:39 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:23:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5924911a-8d97-4e6e-af20-20c4d29406d9 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:39 devstack sudo[87029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5924911a-8d97-4e6e-af20-20c4d29406d9 1073741824
Apr 14 01:23:39 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:39 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3e57b40a-201d-42ce-b431-5db29d7caa5f tempest-VolumesSnapshotTestJSON-869685304 None] Create snapshot completed successfully
Apr 14 01:23:40 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:40 devstack sudo[87039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689" returned: 0 in 0.543s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:40 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Flow 'volume_create_manager' (9a4a3eb7-eb7d-43e0-8554-69f34b200471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6acfba-9ed0-4d70-bcee-3837c5459faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6acfba-9ed0-4d70-bcee-3837c5459faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2735216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8689e353-57f9-4388-9d53-62cd1ecf0135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9716d5f97f264338bfe005d461e9f852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=69580516-9351-40ce-96f1-b418df0b137b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:40Z,use_quota=True,user_id='4b87f6d81d4d47fe884579b8a8cb15eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f9d36b-c9f7-4750-8e5a-3105fc612a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f9d36b-c9f7-4750-8e5a-3105fc612a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76320dc9-d7d1-41ec-bf43-cdf367872523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76320dc9-d7d1-41ec-bf43-cdf367872523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8689e353-57f9-4388-9d53-62cd1ecf0135', 'volume_name': 'volume-8689e353-57f9-4388-9d53-62cd1ecf0135', 'volume_size': 2, 'snapshot_id': '69580516-9351-40ce-96f1-b418df0b137b'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:40 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60351ffa-958c-4b88-9f07-d6963c878ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60351ffa-958c-4b88-9f07-d6963c878ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b542dbb-c19b-4069-92a5-aa954ea34539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:40 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Volume 8689e353-57f9-4388-9d53-62cd1ecf0135: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8689e353-57f9-4388-9d53-62cd1ecf0135', 'volume_size': 2, 'snapshot_id': '69580516-9351-40ce-96f1-b418df0b137b'}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5924911a-8d97-4e6e-af20-20c4d29406d9 1073741824" returned: 0 in 0.621s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5924911a-8d97-4e6e-af20-20c4d29406d9 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:40 devstack sudo[87041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5924911a-8d97-4e6e-af20-20c4d29406d9
Apr 14 01:23:40 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:40 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a2e6c687-fa7a-41fe-8e49-e3cb126cb689" returned: 0 in 0.440s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Lock "cinder-quobyte-a2e6c687-fa7a-41fe-8e49-e3cb126cb689" released by "delete_volume" :: held 1.005s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Created reservations ['facf8b8d-4e71-412d-a78f-77555d46986b', '3f82656e-20d1-4889-9de6-a5f5146793fe', 'b5bf86c5-0e3d-45b0-84ee-bf9058cb3cfc', 'd1d13071-d073-45d7-a381-24f83985207c'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:40 devstack sudo[87044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:23:40 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:40 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5924911a-8d97-4e6e-af20-20c4d29406d9" returned: 0 in 0.429s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.447s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-69580516-9351-40ce-96f1-b418df0b137b-8689e353-57f9-4388-9d53-62cd1ecf0135" by "_create_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd5b886-3b2a-4f84-a357-f70661d327cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5924911a-8d97-4e6e-af20-20c4d29406d9', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b8a7d4-aa6d-46b5-9549-f25edfbd2051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:40 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Volume volume-5924911a-8d97-4e6e-af20-20c4d29406d9 (5924911a-8d97-4e6e-af20-20c4d29406d9): created successfully
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b8a7d4-aa6d-46b5-9549-f25edfbd2051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Flow 'volume_create_manager' (f04f88b7-0c52-407e-873b-e7e8a75b1b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-69580516-9351-40ce-96f1-b418df0b137b-8689e353-57f9-4388-9d53-62cd1ecf0135" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Creating volume 8689e353-57f9-4388-9d53-62cd1ecf0135 from snapshot 69580516-9351-40ce-96f1-b418df0b137b {{(pid=81812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-8689e353-57f9-4388-9d53-62cd1ecf0135" by "_copy_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-8689e353-57f9-4388-9d53-62cd1ecf0135" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] snapshot: 69580516-9351-40ce-96f1-b418df0b137b, volume: 8689e353-57f9-4388-9d53-62cd1ecf0135,  {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 14 01:23:40 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-91320d7d-41a3-44a1-955d-c6fdfef0e02b tempest-VolumesTransfersTest-1574507119 None] Created volume successfully.
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b215f4-9167-4a58-9184-0acbe05d5301]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:40 devstack sudo[87047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b
Apr 14 01:23:40 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:41 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.423s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:23:41 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Deleted volume successfully.
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a745e27e-b18c-46ab-b1d1-342173150fbb tempest-ServersNegativeTestJSON-94018543 None] Lock "cinder-a2e6c687-fa7a-41fe-8e49-e3cb126cb689-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Acquiring lock "cinder-5924911a-8d97-4e6e-af20-20c4d29406d9-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Lock "cinder-5924911a-8d97-4e6e-af20-20c4d29406d9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:41 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Acquiring lock "cinder-quobyte-5924911a-8d97-4e6e-af20-20c4d29406d9" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b" returned: 0 in 0.565s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Creating direct copy from snapshot {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[556a2c7d-bd42-4384-95c2-4e089a146c90]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Lock "cinder-quobyte-5924911a-8d97-4e6e-af20-20c4d29406d9" acquired by "delete_volume" :: waited 0.026s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2981a12-222e-4863-8d3f-90a300209e32]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5924911a-8d97-4e6e-af20-20c4d29406d9 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:41 devstack sudo[87053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949
Apr 14 01:23:41 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:41 devstack sudo[87054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5924911a-8d97-4e6e-af20-20c4d29406d9
Apr 14 01:23:41 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:41 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949" returned: 0 in 0.548s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:41 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG cinder.utils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Path /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135 not found in is_blk_device check {{(pid=81812) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5924911a-8d97-4e6e-af20-20c4d29406d9" returned: 0 in 0.535s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5924911a-8d97-4e6e-af20-20c4d29406d9 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:41 devstack sudo[87063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135
Apr 14 01:23:41 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:42 devstack sudo[87064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5924911a-8d97-4e6e-af20-20c4d29406d9
Apr 14 01:23:42 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:42 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5924911a-8d97-4e6e-af20-20c4d29406d9" returned: 0 in 0.513s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Lock "cinder-quobyte-5924911a-8d97-4e6e-af20-20c4d29406d9" released by "delete_volume" :: held 1.084s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:42 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Created reservations ['02477b11-024d-4a1e-9288-68cfcb5bf60f', '75d08061-0ca2-4224-87e6-826792026a4c', 'db5b6c8c-485a-4546-828a-d73131225fc5', '1777ee54-a310-4864-947f-3017d2f7b0cb'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:42 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:INSERT=52,cinder:SELECT=154,cinder:UPDATE=208,cinder:DELETE=16 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:23:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:43 devstack sudo[87091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:23:43 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:44 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 1.058s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:44 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:23:44 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Deleted volume successfully.
Apr 14 01:23:44 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:SELECT=160,cinder:INSERT=47,cinder:UPDATE=195,cinder:DELETE=20 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:23:44 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c935960b-0ecf-42f9-8b12-3a6e4351ff39 tempest-VolumesTransfersTest-1663288508 None] Lock "cinder-5924911a-8d97-4e6e-af20-20c4d29406d9-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:44 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135" returned: 0 in 2.485s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:44 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e619454d-4ba4-4fbc-b2ef-d0cf618be68a]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:44 devstack sudo[87110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949
Apr 14 01:23:44 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:45 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949" returned: 0 in 0.683s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:45 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135 {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:23:45 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Converted 1024.00 MB image at 411.94 MB/s
Apr 14 01:23:45 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135 is being set with open permissions: ugo+rw
Apr 14 01:23:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:45 devstack sudo[87116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135
Apr 14 01:23:45 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:45 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135" returned: 0 in 0.493s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-8689e353-57f9-4388-9d53-62cd1ecf0135" released by "_copy_volume_from_snapshot" :: held 4.840s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-69580516-9351-40ce-96f1-b418df0b137b-8689e353-57f9-4388-9d53-62cd1ecf0135" released by "_create_volume_from_snapshot" :: held 4.866s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.914s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b542dbb-c19b-4069-92a5-aa954ea34539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8689e353-57f9-4388-9d53-62cd1ecf0135', 'volume_size': 2, 'snapshot_id': '69580516-9351-40ce-96f1-b418df0b137b'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c07ab8-d6bb-43d5-97ad-660c464fd4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:45 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Volume volume-8689e353-57f9-4388-9d53-62cd1ecf0135 (8689e353-57f9-4388-9d53-62cd1ecf0135): created successfully
Apr 14 01:23:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c07ab8-d6bb-43d5-97ad-660c464fd4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Flow 'volume_create_manager' (9a4a3eb7-eb7d-43e0-8554-69f34b200471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:45 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-6b0dfc2b-f987-466b-8978-c9d5543ba533 tempest-VolumesSnapshotTestJSON-869685304 None] Created volume successfully.
Apr 14 01:23:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-8689e353-57f9-4388-9d53-62cd1ecf0135-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-8689e353-57f9-4388-9d53-62cd1ecf0135-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-8689e353-57f9-4388-9d53-62cd1ecf0135" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-8689e353-57f9-4388-9d53-62cd1ecf0135" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:46 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4457cf85-fa13-449e-b4a9-257c3147e571]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:46 devstack sudo[87119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135
Apr 14 01:23:46 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:47 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135" returned: 0 in 0.504s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:47 devstack sudo[87125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135
Apr 14 01:23:47 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Flow 'volume_create_manager' (a5e91fe8-3270-4945-b92f-f2d69aa2218b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273302c2-4f80-4d63-9178-127ed8527896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273302c2-4f80-4d63-9178-127ed8527896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1385077689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51515329-9be9-4a67-9913-53d074b7c19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49e03368360412f8ad56cca08ac8670',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:48Z,use_quota=True,user_id='38384cd0b21343a4a41cabf8b85f48d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf94a925-0f3c-437a-9d7b-911be25bbf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf94a925-0f3c-437a-9d7b-911be25bbf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f64ce3-534f-4de3-8c8f-501514706a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f64ce3-534f-4de3-8c8f-501514706a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51515329-9be9-4a67-9913-53d074b7c19c', 'volume_name': 'volume-51515329-9be9-4a67-9913-53d074b7c19c', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae563e36-8aaf-408c-917b-29e5ab193f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae563e36-8aaf-408c-917b-29e5ab193f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8179241d-f75a-44d5-9703-2ea74adad3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:47 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Volume 51515329-9be9-4a67-9913-53d074b7c19c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51515329-9be9-4a67-9913-53d074b7c19c', 'volume_size': 1}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1385077689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51515329-9be9-4a67-9913-53d074b7c19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49e03368360412f8ad56cca08ac8670',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:48Z,use_quota=True,user_id='38384cd0b21343a4a41cabf8b85f48d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Creating volume 51515329-9be9-4a67-9913-53d074b7c19c {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:23:47 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:47 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8689e353-57f9-4388-9d53-62cd1ecf0135" returned: 0 in 0.452s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-8689e353-57f9-4388-9d53-62cd1ecf0135" released by "delete_volume" :: held 0.988s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:47 devstack sudo[87128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c 1073741824
Apr 14 01:23:47 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Created reservations ['30ee840a-e455-4ba4-bccb-a4708939ac53', 'ae94caa5-d291-49e9-b381-45434ad0f30c', 'c1ea75cd-6a78-4b02-914f-fc46e54b3307', 'f27f2aa5-0d6f-4597-8a6d-17810e3c73b1'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:47 devstack sudo[87130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:23:47 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-69580516-9351-40ce-96f1-b418df0b137b-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-69580516-9351-40ce-96f1-b418df0b137b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-b2428d4d-4a20-4bdd-ad42-92ca8a20d949" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-b2428d4d-4a20-4bdd-ad42-92ca8a20d949" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-69580516-9351-40ce-96f1-b418df0b137b" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-69580516-9351-40ce-96f1-b418df0b137b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Deleting offline snapshot 69580516-9351-40ce-96f1-b418df0b137b of volume b2428d4d-4a20-4bdd-ad42-92ca8a20d949 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] snapshot_file for this snap is: volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[82928d80-8f47-43f0-beeb-3a8eb585dbad]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:48 devstack sudo[87132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b
Apr 14 01:23:48 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:48 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c 1073741824" returned: 0 in 0.553s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:48 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.492s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:23:48 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Deleted volume successfully.
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3f7ea261-97c2-4b4c-8fdc-963ee9d2c8e7 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-8689e353-57f9-4388-9d53-62cd1ecf0135-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:48 devstack sudo[87138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c
Apr 14 01:23:48 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:48 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b" returned: 0 in 0.600s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf144d5-14a8-4b7f-9bad-25dd99beeb79]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:48 devstack sudo[87143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949
Apr 14 01:23:48 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:48 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c" returned: 0 in 0.517s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8179241d-f75a-44d5-9703-2ea74adad3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51515329-9be9-4a67-9913-53d074b7c19c', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5853d4-7969-4998-a584-14e6c0c80acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:48 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Volume volume-51515329-9be9-4a67-9913-53d074b7c19c (51515329-9be9-4a67-9913-53d074b7c19c): created successfully
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5853d4-7969-4998-a584-14e6c0c80acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:48 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Flow 'volume_create_manager' (a5e91fe8-3270-4945-b92f-f2d69aa2218b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:48 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-98d90e9a-da1e-4e57-89bf-372e479bfde4 tempest-VolumesCloneTest-1535030287 None] Created volume successfully.
Apr 14 01:23:49 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949" returned: 0 in 0.519s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:49 devstack sudo[87149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b
Apr 14 01:23:49 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:49 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b" returned: 0 in 0.493s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:49 devstack sudo[87155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b
Apr 14 01:23:49 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:50 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949.69580516-9351-40ce-96f1-b418df0b137b" returned: 0 in 0.514s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Flow 'volume_create_manager' (b9c362ba-885d-4e9e-9794-b0f1dc373df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (018e5cb0-0dbf-480c-b713-485a90df405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (018e5cb0-0dbf-480c-b713-485a90df405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-706235764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a6221a9-d10f-41c6-b300-7d26660a72c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49e03368360412f8ad56cca08ac8670',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=51515329-9be9-4a67-9913-53d074b7c19c,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:50Z,use_quota=True,user_id='38384cd0b21343a4a41cabf8b85f48d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e4636b-1719-4204-a884-a9a4517acb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e4636b-1719-4204-a884-a9a4517acb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d41bd4a-0bd9-4485-95ae-6595a6bd7243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d41bd4a-0bd9-4485-95ae-6595a6bd7243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2a6221a9-d10f-41c6-b300-7d26660a72c1', 'volume_name': 'volume-2a6221a9-d10f-41c6-b300-7d26660a72c1', 'volume_size': 2, 'source_volid': '51515329-9be9-4a67-9913-53d074b7c19c', 'source_volstatus': 'available'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccb8fbc-d190-4996-ac77-eddcd8ff0414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccb8fbc-d190-4996-ac77-eddcd8ff0414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b23cc15-86f2-4052-9ba9-3abf59dd42b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:50 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Volume 2a6221a9-d10f-41c6-b300-7d26660a72c1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2a6221a9-d10f-41c6-b300-7d26660a72c1', 'volume_size': 2, 'source_volid': '51515329-9be9-4a67-9913-53d074b7c19c', 'source_volstatus': 'available'}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-69580516-9351-40ce-96f1-b418df0b137b" released by "_delete_snapshot" :: held 2.281s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-b2428d4d-4a20-4bdd-ad42-92ca8a20d949" released by "delete_snapshot" :: held 2.301s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:50 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Cloning volume 51515329-9be9-4a67-9913-53d074b7c19c to volume 2a6221a9-d10f-41c6-b300-7d26660a72c1
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Creating offline snapshot a2c9ceef-9e96-4414-b618-106a0fadfd30 of volume 51515329-9be9-4a67-9913-53d074b7c19c {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e1270e-9399-4363-8df1-3ef9d0bd820e]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Created reservations ['3feb59b5-e231-4f06-a6c6-84a946ce85c9', '658d1b76-464d-4e82-a45e-ac0838cabcfd', '68b17d4a-d8c4-4a66-a01a-0256898a4d86', '6485674f-1f9e-4cb7-984a-64595bf09062'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:50 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Delete snapshot completed successfully.
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ed9c1a41-60d8-4e2e-834c-7a7dc0cd8f7b tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-69580516-9351-40ce-96f1-b418df0b137b-delete_snapshot" released by "delete_snapshot" :: held 2.446s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:50 devstack sudo[87158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c
Apr 14 01:23:50 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:50 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c" returned: 0 in 0.612s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:50 devstack sudo[87164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30 1G
Apr 14 01:23:50 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-b2428d4d-4a20-4bdd-ad42-92ca8a20d949-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-b2428d4d-4a20-4bdd-ad42-92ca8a20d949-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-b2428d4d-4a20-4bdd-ad42-92ca8a20d949" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-b2428d4d-4a20-4bdd-ad42-92ca8a20d949" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:51 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[513b8072-d282-4a54-9001-4b8ca58158b6]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:51 devstack sudo[87166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949
Apr 14 01:23:51 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:51 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30 1G" returned: 0 in 0.536s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51515329-9be9-4a67-9913-53d074b7c19c -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:51 devstack sudo[87171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51515329-9be9-4a67-9913-53d074b7c19c -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30
Apr 14 01:23:51 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:51 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949" returned: 0 in 0.525s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:51 devstack sudo[87176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949
Apr 14 01:23:51 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:51 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51515329-9be9-4a67-9913-53d074b7c19c -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30" returned: 0 in 0.507s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:52 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30 is being set with open permissions: ugo+rw
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:52 devstack sudo[87181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30
Apr 14 01:23:52 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:52 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b2428d4d-4a20-4bdd-ad42-92ca8a20d949" returned: 0 in 0.514s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-b2428d4d-4a20-4bdd-ad42-92ca8a20d949" released by "delete_volume" :: held 1.070s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Created reservations ['abbee99c-6842-42f0-a4a3-65ecbdd1842c', 'ede49152-a9f3-4a9e-9b12-69c8038b8981', 'f48f6be1-4d8c-4454-bbd5-64190848c8c4', '693c8aa6-93ec-4c35-b385-f32c3db976dc'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:52 devstack sudo[87185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:23:52 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:52 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30" returned: 0 in 0.462s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:52 devstack sudo[87187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.info
Apr 14 01:23:52 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:52 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.438s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:23:52 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Deleted volume successfully.
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6d9580dc-9afc-4b8e-af33-234deda47549 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-b2428d4d-4a20-4bdd-ad42-92ca8a20d949-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:52 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.info" returned: 0 in 0.474s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:52 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.info is being set with open permissions: ugo+rw
Apr 14 01:23:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:52 devstack sudo[87191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.info
Apr 14 01:23:52 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:53 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.info" returned: 0 in 0.449s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Acquiring lock "cinder-quobyte-2a6221a9-d10f-41c6-b300-7d26660a72c1" by "_copy_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Lock "cinder-quobyte-2a6221a9-d10f-41c6-b300-7d26660a72c1" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] snapshot: a2c9ceef-9e96-4414-b618-106a0fadfd30, volume: 2a6221a9-d10f-41c6-b300-7d26660a72c1,  {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[83479a68-f148-4c9b-a796-7647f728c811]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:53 devstack sudo[87194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30
Apr 14 01:23:53 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Flow 'volume_create_manager' (2b4e7ab0-f968-4e1d-af9b-f2e92649a695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb090f30-fd4f-49b3-8c07-49278bdfbe96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb090f30-fd4f-49b3-8c07-49278bdfbe96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1349533139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1ab5db3-508b-42fb-a5b3-a37bd3716789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9716d5f97f264338bfe005d461e9f852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:54Z,use_quota=True,user_id='4b87f6d81d4d47fe884579b8a8cb15eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db8f903-b650-4708-8c9e-3b486003eed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db8f903-b650-4708-8c9e-3b486003eed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74790e7e-87fa-4f0c-a44b-4ee614dc0d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74790e7e-87fa-4f0c-a44b-4ee614dc0d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1ab5db3-508b-42fb-a5b3-a37bd3716789', 'volume_name': 'volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215e2608-6e73-4996-839b-ca9db55bb271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215e2608-6e73-4996-839b-ca9db55bb271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cef5c2-0aef-4cba-8287-ad6150291662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:53 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Volume f1ab5db3-508b-42fb-a5b3-a37bd3716789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789', 'volume_size': 1}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Flow 'volume_create_manager' (1cbf021f-1e33-405e-94d9-8dc0f1216d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b4c98b-bfb1-4648-9dd4-8bb7be671019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b4c98b-bfb1-4648-9dd4-8bb7be671019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1872714748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01fec25-de0b-44b8-9d3d-3b3656b576d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641994141dae4c84a7f8b28ccd40828d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:54Z,use_quota=True,user_id='e33e22e6890c41959a3481172c21c981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038a3020-fb9c-4103-8bbc-fe4be506f265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038a3020-fb9c-4103-8bbc-fe4be506f265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5369a176-9404-48de-a3f6-3c0d06e30d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5369a176-9404-48de-a3f6-3c0d06e30d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01fec25-de0b-44b8-9d3d-3b3656b576d6', 'volume_name': 'volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b8c5a5-04ea-470b-a447-acac8d892241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b8c5a5-04ea-470b-a447-acac8d892241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02de6299-37dd-44bf-b138-a5913bc00b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:53 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Volume f01fec25-de0b-44b8-9d3d-3b3656b576d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6', 'volume_size': 1}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:53 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30" returned: 0 in 0.511s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51515329-9be9-4a67-9913-53d074b7c19c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Creating direct copy from snapshot {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b931f7c9-a54d-4487-a90b-a015ab88fbc6]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:54 devstack sudo[87199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c
Apr 14 01:23:54 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:54 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c" returned: 0 in 0.487s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:54 devstack cinder-volume[81812]: DEBUG cinder.utils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Path /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1 not found in is_blk_device check {{(pid=81812) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 14 01:23:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:54 devstack sudo[87204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1
Apr 14 01:23:54 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:56 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1" returned: 0 in 2.165s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:56 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbd612d-0abf-40f0-952b-912032b9d967]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:56 devstack sudo[87217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c
Apr 14 01:23:56 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:57 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c" returned: 0 in 0.623s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:57 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1 {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:23:57 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Converted 1024.00 MB image at 472.63 MB/s
Apr 14 01:23:57 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1 is being set with open permissions: ugo+rw
Apr 14 01:23:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:57 devstack sudo[87222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1
Apr 14 01:23:57 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:57 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1" returned: 0 in 0.403s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Lock "cinder-quobyte-2a6221a9-d10f-41c6-b300-7d26660a72c1" released by "_copy_volume_from_snapshot" :: held 4.239s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Acquiring lock "cinder-quobyte-a2c9ceef-9e96-4414-b618-106a0fadfd30" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:23:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Lock "cinder-quobyte-a2c9ceef-9e96-4414-b618-106a0fadfd30" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:23:57 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Deleting offline snapshot a2c9ceef-9e96-4414-b618-106a0fadfd30 of volume 51515329-9be9-4a67-9913-53d074b7c19c {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:23:57 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] snapshot_file for this snap is: volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:23:57 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ab852d-73fe-41b1-bd3b-574c26134a38]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:57 devstack sudo[87226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30
Apr 14 01:23:57 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:58 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30" returned: 0 in 0.507s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51515329-9be9-4a67-9913-53d074b7c19c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:23:58 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9650fedf-6d0f-4a30-b6b3-0fddb3df73d8]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:23:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:58 devstack sudo[87231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c
Apr 14 01:23:58 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:58 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c" returned: 0 in 0.490s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:58 devstack sudo[87236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30
Apr 14 01:23:58 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:59 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30" returned: 0 in 0.457s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:59 devstack sudo[87241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30
Apr 14 01:23:59 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:59 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c.a2c9ceef-9e96-4414-b618-106a0fadfd30" returned: 0 in 0.404s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Lock "cinder-quobyte-a2c9ceef-9e96-4414-b618-106a0fadfd30" released by "_delete_snapshot" :: held 1.904s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.308s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.849s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1349533139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1ab5db3-508b-42fb-a5b3-a37bd3716789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9716d5f97f264338bfe005d461e9f852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:54Z,use_quota=True,user_id='4b87f6d81d4d47fe884579b8a8cb15eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Creating volume f1ab5db3-508b-42fb-a5b3-a37bd3716789 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:23:59 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b23cc15-86f2-4052-9ba9-3abf59dd42b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a6221a9-d10f-41c6-b300-7d26660a72c1', 'volume_size': 2, 'source_volid': '51515329-9be9-4a67-9913-53d074b7c19c', 'source_volstatus': 'available'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:59 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 1073741824
Apr 14 01:23:59 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd66bde-2688-4941-8e72-6da892ecd799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:23:59 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Volume volume-2a6221a9-d10f-41c6-b300-7d26660a72c1 (2a6221a9-d10f-41c6-b300-7d26660a72c1): created successfully
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd66bde-2688-4941-8e72-6da892ecd799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:23:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Flow 'volume_create_manager' (b9c362ba-885d-4e9e-9794-b0f1dc373df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:23:59 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-530cba6a-db42-40fa-a3b5-54d44b2c7374 tempest-VolumesCloneTest-1535030287 None] Created volume successfully.
Apr 14 01:24:00 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 1073741824" returned: 0 in 0.495s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:00 devstack sudo[87249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789
Apr 14 01:24:00 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:00 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789" returned: 0 in 0.404s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.710s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1872714748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01fec25-de0b-44b8-9d3d-3b3656b576d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641994141dae4c84a7f8b28ccd40828d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:23:54Z,use_quota=True,user_id='e33e22e6890c41959a3481172c21c981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Creating volume f01fec25-de0b-44b8-9d3d-3b3656b576d6 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:24:00 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cef5c2-0aef-4cba-8287-ad6150291662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:00 devstack sudo[87252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6 1073741824
Apr 14 01:24:00 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0ee3f1-1734-4efe-9acf-d010e51b3d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:00 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Volume volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 (f1ab5db3-508b-42fb-a5b3-a37bd3716789): created successfully
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0ee3f1-1734-4efe-9acf-d010e51b3d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Flow 'volume_create_manager' (2b4e7ab0-f968-4e1d-af9b-f2e92649a695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:00 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f8794e2b-6f5d-421d-8b71-b8e33f7dd742 tempest-VolumesSnapshotTestJSON-869685304 None] Created volume successfully.
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Acquiring lock "cinder-2a6221a9-d10f-41c6-b300-7d26660a72c1-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Lock "cinder-2a6221a9-d10f-41c6-b300-7d26660a72c1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Acquiring lock "cinder-quobyte-2a6221a9-d10f-41c6-b300-7d26660a72c1" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Lock "cinder-quobyte-2a6221a9-d10f-41c6-b300-7d26660a72c1" acquired by "delete_volume" :: waited 0.016s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd94ea3-8db9-4d25-bd3d-62029662e9bf]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:00 devstack sudo[87254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1
Apr 14 01:24:00 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:01 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6 1073741824" returned: 0 in 0.545s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:01 devstack sudo[87259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6
Apr 14 01:24:01 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:01 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1" returned: 0 in 0.543s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:01 devstack sudo[87264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1
Apr 14 01:24:01 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:01 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6" returned: 0 in 0.439s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.323s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02de6299-37dd-44bf-b138-a5913bc00b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba7103c-b91b-4021-ad99-e4f4366d859c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] Creating offline snapshot 1143f733-6f47-45f0-922b-3d947040f69b of volume f1ab5db3-508b-42fb-a5b3-a37bd3716789 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:24:01 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Volume volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6 (f01fec25-de0b-44b8-9d3d-3b3656b576d6): created successfully
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba7103c-b91b-4021-ad99-e4f4366d859c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Flow 'volume_create_manager' (1cbf021f-1e33-405e-94d9-8dc0f1216d8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d4a9cd-3408-484d-861d-ca8c498c646d]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:01 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-76ca83eb-2048-41ab-97c4-1d923500d680 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Created volume successfully.
Apr 14 01:24:01 devstack sudo[87267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789
Apr 14 01:24:01 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:01 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-2a6221a9-d10f-41c6-b300-7d26660a72c1" returned: 0 in 0.421s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Lock "cinder-quobyte-2a6221a9-d10f-41c6-b300-7d26660a72c1" released by "delete_volume" :: held 0.985s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Created reservations ['c26ad771-5a59-41fa-95e1-e0b47bd09d0c', '327c91c4-47d9-4198-b955-967a1482d9be', '19d617c4-2520-418c-bdda-3b32bdfc8831', '797e5765-582f-45af-b4ee-c979903b92df'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:01 devstack sudo[87270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:01 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:02 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789" returned: 0 in 0.477s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:02 devstack sudo[87275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b 1G
Apr 14 01:24:02 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Acquiring lock "cinder-f01fec25-de0b-44b8-9d3d-3b3656b576d6-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Lock "cinder-f01fec25-de0b-44b8-9d3d-3b3656b576d6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:02 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Acquiring lock "cinder-quobyte-f01fec25-de0b-44b8-9d3d-3b3656b576d6" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.481s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:02 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Deleted volume successfully.
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Lock "cinder-quobyte-f01fec25-de0b-44b8-9d3d-3b3656b576d6" acquired by "delete_volume" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[827ef344-7212-4789-8e94-d16f8b032abc]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-238c1a16-3c72-4dd2-9b4e-5baaa23f7743 tempest-VolumesCloneTest-1535030287 None] Lock "cinder-2a6221a9-d10f-41c6-b300-7d26660a72c1-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:02 devstack sudo[87278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6
Apr 14 01:24:02 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:02 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b 1G" returned: 0 in 0.535s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:02 devstack sudo[87283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b
Apr 14 01:24:02 devstack sudo[87283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:02 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6" returned: 0 in 0.501s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:02 devstack sudo[87288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6
Apr 14 01:24:02 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Acquiring lock "cinder-51515329-9be9-4a67-9913-53d074b7c19c-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Lock "cinder-51515329-9be9-4a67-9913-53d074b7c19c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Acquiring lock "cinder-quobyte-51515329-9be9-4a67-9913-53d074b7c19c" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Lock "cinder-quobyte-51515329-9be9-4a67-9913-53d074b7c19c" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[747a9bb6-9b9a-445d-b032-bfe4dd8543f7]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:03 devstack sudo[87283]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b" returned: 0 in 0.453s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:03 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b is being set with open permissions: ugo+rw
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:03 devstack sudo[87294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b
Apr 14 01:24:03 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:03 devstack sudo[87293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c
Apr 14 01:24:03 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:03 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f01fec25-de0b-44b8-9d3d-3b3656b576d6" returned: 0 in 0.437s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Lock "cinder-quobyte-f01fec25-de0b-44b8-9d3d-3b3656b576d6" released by "delete_volume" :: held 0.962s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Created reservations ['79bea907-8637-44aa-b3de-170fdebf549a', '49234dce-dd7a-4c7a-b364-a32f720f3ac9', 'b47fe864-f390-4ee7-9b8f-e2b0bcdb4f74', 'fb4bc5ef-44c1-446b-995a-de63e3c8d363'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:03 devstack sudo[87299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:03 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:03 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b" returned: 0 in 0.442s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:03 devstack sudo[87304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.info
Apr 14 01:24:03 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:03 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c" returned: 0 in 0.517s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:03 devstack sudo[87306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c
Apr 14 01:24:03 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:03 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.443s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:03 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Deleted volume successfully.
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-72f5150c-69de-4679-b490-63b9bc954d04 tempest-VolumeQuotasAdminTestJSON-1535451052 None] Lock "cinder-f01fec25-de0b-44b8-9d3d-3b3656b576d6-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_service.periodic_task [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81812) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:03 devstack sudo[87311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:03 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:03 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.info" returned: 0 in 0.441s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:03 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.info is being set with open permissions: ugo+rw
Apr 14 01:24:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:03 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-51515329-9be9-4a67-9913-53d074b7c19c" returned: 0 in 0.421s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Lock "cinder-quobyte-51515329-9be9-4a67-9913-53d074b7c19c" released by "delete_volume" :: held 0.970s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:04 devstack sudo[87313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.info
Apr 14 01:24:04 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Created reservations ['558ecdad-391d-48c4-91a6-9dc783a23374', '234349e5-e99c-4c7e-8404-293c606bc763', '85c9a59c-c7a9-445d-9cf9-830e5deb40a2', '23fab44d-2aae-4c2b-be74-680443fb4233'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:04 devstack sudo[87315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:04 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:04 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:04 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.info" returned: 0 in 0.411s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.844s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.473s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:04 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5f2a7e2e-cefc-44a1-85cc-acf90cf055be tempest-VolumesSnapshotTestJSON-869685304 None] Create snapshot completed successfully
Apr 14 01:24:04 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.445s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:04 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Deleted volume successfully.
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-66813411-bcda-451c-8b59-40cd1dd19fa7 tempest-VolumesCloneTest-1535030287 None] Lock "cinder-51515329-9be9-4a67-9913-53d074b7c19c-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Flow 'volume_create_manager' (1f66b711-284c-451b-8690-d9a2a75b0000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9956aad-5393-43b1-9c25-6d1176f2b128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9956aad-5393-43b1-9c25-6d1176f2b128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1516617743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46494726-d2cd-469b-99e5-66e166e9b47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641994141dae4c84a7f8b28ccd40828d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:05Z,use_quota=True,user_id='e33e22e6890c41959a3481172c21c981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a8bdfe-1ee0-4e98-a692-800715bcbaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a8bdfe-1ee0-4e98-a692-800715bcbaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3414187e-6204-49ed-bba9-b212bc61ef0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3414187e-6204-49ed-bba9-b212bc61ef0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46494726-d2cd-469b-99e5-66e166e9b47f', 'volume_name': 'volume-46494726-d2cd-469b-99e5-66e166e9b47f', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c1ff43-a69f-416d-834c-03d2bc55e62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c1ff43-a69f-416d-834c-03d2bc55e62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4c2b73-c0a3-4162-9337-190e180bb235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:04 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Volume 46494726-d2cd-469b-99e5-66e166e9b47f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46494726-d2cd-469b-99e5-66e166e9b47f', 'volume_size': 1}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1516617743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46494726-d2cd-469b-99e5-66e166e9b47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641994141dae4c84a7f8b28ccd40828d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:05Z,use_quota=True,user_id='e33e22e6890c41959a3481172c21c981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Creating volume 46494726-d2cd-469b-99e5-66e166e9b47f {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:24:04 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:24:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46494726-d2cd-469b-99e5-66e166e9b47f 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:04 devstack sudo[87326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46494726-d2cd-469b-99e5-66e166e9b47f 1073741824
Apr 14 01:24:04 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:05 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46494726-d2cd-469b-99e5-66e166e9b47f 1073741824" returned: 0 in 0.516s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46494726-d2cd-469b-99e5-66e166e9b47f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:05 devstack sudo[87331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46494726-d2cd-469b-99e5-66e166e9b47f
Apr 14 01:24:05 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Flow 'volume_create_manager' (fc9b0faa-3b26-4f98-8ef2-388e66396e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483d5006-3d4e-4b00-8562-0d0fca12e226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483d5006-3d4e-4b00-8562-0d0fca12e226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-439526509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524251e7-77ce-4eaf-bac6-63a52306cceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9716d5f97f264338bfe005d461e9f852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1143f733-6f47-45f0-922b-3d947040f69b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:06Z,use_quota=True,user_id='4b87f6d81d4d47fe884579b8a8cb15eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6fea91-c084-459f-8d91-61b5c9824826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6fea91-c084-459f-8d91-61b5c9824826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a061dc98-f41b-4aea-bd3d-31b08a2acd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a061dc98-f41b-4aea-bd3d-31b08a2acd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '524251e7-77ce-4eaf-bac6-63a52306cceb', 'volume_name': 'volume-524251e7-77ce-4eaf-bac6-63a52306cceb', 'volume_size': 1, 'snapshot_id': '1143f733-6f47-45f0-922b-3d947040f69b'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993ccb6b-609a-4229-baa9-7bebb06278dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993ccb6b-609a-4229-baa9-7bebb06278dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b331bc09-6ca4-4c4e-94fa-170ffe2bd7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:05 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Volume 524251e7-77ce-4eaf-bac6-63a52306cceb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-524251e7-77ce-4eaf-bac6-63a52306cceb', 'volume_size': 1, 'snapshot_id': '1143f733-6f47-45f0-922b-3d947040f69b'}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:05 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46494726-d2cd-469b-99e5-66e166e9b47f" returned: 0 in 0.512s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.078s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-1143f733-6f47-45f0-922b-3d947040f69b-524251e7-77ce-4eaf-bac6-63a52306cceb" by "_create_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4c2b73-c0a3-4162-9337-190e180bb235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46494726-d2cd-469b-99e5-66e166e9b47f', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eecc687-44e1-4e38-9330-7ffffcd6ffe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-1143f733-6f47-45f0-922b-3d947040f69b-524251e7-77ce-4eaf-bac6-63a52306cceb" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Creating volume 524251e7-77ce-4eaf-bac6-63a52306cceb from snapshot 1143f733-6f47-45f0-922b-3d947040f69b {{(pid=81812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-524251e7-77ce-4eaf-bac6-63a52306cceb" by "_copy_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:05 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Volume volume-46494726-d2cd-469b-99e5-66e166e9b47f (46494726-d2cd-469b-99e5-66e166e9b47f): created successfully
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eecc687-44e1-4e38-9330-7ffffcd6ffe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Flow 'volume_create_manager' (1f66b711-284c-451b-8690-d9a2a75b0000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-524251e7-77ce-4eaf-bac6-63a52306cceb" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] snapshot: 1143f733-6f47-45f0-922b-3d947040f69b, volume: 524251e7-77ce-4eaf-bac6-63a52306cceb,  {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:05 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8cbd70d3-7c17-453f-898a-8a0d09f2784e tempest-VolumeQuotasAdminTestJSON-1535451052 None] Created volume successfully.
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41a1bec-798a-4db7-a887-e425d7c8c69d]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:06 devstack sudo[87334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b
Apr 14 01:24:06 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:06 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b" returned: 0 in 0.603s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:24:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 14 01:24:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Creating direct copy from snapshot {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 14 01:24:06 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f61facd-86aa-42c0-ae30-584d94ac34fd]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:06 devstack sudo[87339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789
Apr 14 01:24:06 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:07 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789" returned: 0 in 0.543s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.utils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Path /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb not found in is_blk_device check {{(pid=81812) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:07 devstack sudo[87344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb
Apr 14 01:24:07 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Flow 'volume_create_manager' (96c3e19b-cc96-47ac-bcc1-a58a094ff93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45230333-20bd-4dfe-a41f-0711a7027619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:07 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3085a15c-e8c3-48e0-8609-f227612777fb tempest-VolumeQuotasAdminTestJSON-2126168744 None] Transfer volume completed successfully.
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45230333-20bd-4dfe-a41f-0711a7027619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-218418988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592bb0df-f589-4471-9869-abe5634d9a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c75259f4e342d1b7e793b4bdcd36a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:07Z,use_quota=True,user_id='5cc7174a4e844722b7e243f2444d39ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b254532-2fff-46d2-b0a1-d427e84ff75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b254532-2fff-46d2-b0a1-d427e84ff75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6e9098-5815-4701-ae50-607bb2b79dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.image.glance [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Creating Keystone auth plugin from conf {{(pid=81812) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6e9098-5815-4701-ae50-607bb2b79dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '592bb0df-f589-4471-9869-abe5634d9a7b', 'volume_name': 'volume-592bb0df-f589-4471-9869-abe5634d9a7b', 'volume_size': 1, 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '632509b247064588826fa463262eaec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'created_at': datetime.datetime(2026, 4, 13, 23, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 23, 14, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f70df38c1c0>}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44412a0-8ee2-467c-a2e1-d7ea89cb9901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44412a0-8ee2-467c-a2e1-d7ea89cb9901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50023419-87d0-4656-ab7b-eaf7045bd9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:07 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Volume 592bb0df-f589-4471-9869-abe5634d9a7b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-592bb0df-f589-4471-9869-abe5634d9a7b', 'volume_size': 1, 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '632509b247064588826fa463262eaec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'created_at': datetime.datetime(2026, 4, 13, 23, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 23, 14, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f70df38c1c0>}
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Trying to clone 592bb0df-f589-4471-9869-abe5634d9a7b from image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c at location (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]). {{(pid=81812) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 14 01:24:07 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kfsuc5n3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81812) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 14 01:24:07 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Image download 20.69 MB at 20.69 MB/s
Apr 14 01:24:08 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcf3f19-2706-4365-855f-2bc60b946805]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kfsuc5n3devstack@QuobyteHD {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:08 devstack sudo[87358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kfsuc5n3devstack@QuobyteHD
Apr 14 01:24:08 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Acquiring lock "cinder-46494726-d2cd-469b-99e5-66e166e9b47f-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Lock "cinder-46494726-d2cd-469b-99e5-66e166e9b47f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Acquiring lock "cinder-quobyte-46494726-d2cd-469b-99e5-66e166e9b47f" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Lock "cinder-quobyte-46494726-d2cd-469b-99e5-66e166e9b47f" acquired by "delete_volume" :: waited 0.013s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:08 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[69190630-616f-4d19-9d65-190a08624ce4]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46494726-d2cd-469b-99e5-66e166e9b47f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:08 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kfsuc5n3devstack@QuobyteHD" returned: 0 in 0.809s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:08 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Temporary image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c is fetched for user 5cc7174a4e844722b7e243f2444d39ea. {{(pid=81812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 14 01:24:08 devstack sudo[87363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46494726-d2cd-469b-99e5-66e166e9b47f
Apr 14 01:24:08 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:08 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8679765f-2ba7-49ef-a8ed-290de11d5368]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kfsuc5n3devstack@QuobyteHD {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:09 devstack sudo[87365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kfsuc5n3devstack@QuobyteHD
Apr 14 01:24:09 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:09 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb" returned: 0 in 2.350s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:09 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb11e3e6-45e5-41cc-8981-ed2b3452b15b]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:09 devstack sudo[87368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789
Apr 14 01:24:09 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:09 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kfsuc5n3devstack@QuobyteHD" returned: 0 in 0.758s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:09 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46494726-d2cd-469b-99e5-66e166e9b47f" returned: 0 in 1.003s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46494726-d2cd-469b-99e5-66e166e9b47f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:09 devstack sudo[87376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46494726-d2cd-469b-99e5-66e166e9b47f
Apr 14 01:24:09 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:10 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789" returned: 0 in 0.603s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789, size 1024.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:24:10 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Converted 1024.00 MB image at 435.44 MB/s
Apr 14 01:24:10 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb is being set with open permissions: ugo+rw
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:10 devstack sudo[87381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb
Apr 14 01:24:10 devstack sudo[87381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:10 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46494726-d2cd-469b-99e5-66e166e9b47f" returned: 0 in 0.411s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Lock "cinder-quobyte-46494726-d2cd-469b-99e5-66e166e9b47f" released by "delete_volume" :: held 1.458s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Created reservations ['3f02d05d-e14f-4f0c-a629-d1635c3de395', 'ea0012c4-1a93-44f1-8529-dd2df2bd5465', '51fc438e-719d-411d-b499-d7a07449f053', '34d7ca50-0d20-46b0-8613-85162136a536'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:10 devstack sudo[87384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:10 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:10 devstack sudo[87381]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb" returned: 0 in 0.438s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-524251e7-77ce-4eaf-bac6-63a52306cceb" released by "_copy_volume_from_snapshot" :: held 4.604s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-1143f733-6f47-45f0-922b-3d947040f69b-524251e7-77ce-4eaf-bac6-63a52306cceb" released by "_create_volume_from_snapshot" :: held 4.633s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.652s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.770s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-218418988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592bb0df-f589-4471-9869-abe5634d9a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c75259f4e342d1b7e793b4bdcd36a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:07Z,use_quota=True,user_id='5cc7174a4e844722b7e243f2444d39ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Creating volume 592bb0df-f589-4471-9869-abe5634d9a7b {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:24:10 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:10 devstack sudo[87387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b 1073741824
Apr 14 01:24:10 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b331bc09-6ca4-4c4e-94fa-170ffe2bd7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524251e7-77ce-4eaf-bac6-63a52306cceb', 'volume_size': 1, 'snapshot_id': '1143f733-6f47-45f0-922b-3d947040f69b'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb513158-627f-4d10-b888-253151ab478a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:10 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Volume volume-524251e7-77ce-4eaf-bac6-63a52306cceb (524251e7-77ce-4eaf-bac6-63a52306cceb): created successfully
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb513158-627f-4d10-b888-253151ab478a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Flow 'volume_create_manager' (fc9b0faa-3b26-4f98-8ef2-388e66396e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:10 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-edf677f4-10d3-4b7d-8903-156c6861aea6 tempest-VolumesSnapshotTestJSON-869685304 None] Created volume successfully.
Apr 14 01:24:10 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.410s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:10 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Deleted volume successfully.
Apr 14 01:24:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-09e6b315-5daf-43ea-a5ad-6546b480401d tempest-VolumeQuotasAdminTestJSON-1355568427 None] Lock "cinder-46494726-d2cd-469b-99e5-66e166e9b47f-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:11 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b 1073741824" returned: 0 in 0.535s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:11 devstack sudo[87393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b
Apr 14 01:24:11 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-524251e7-77ce-4eaf-bac6-63a52306cceb-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-524251e7-77ce-4eaf-bac6-63a52306cceb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-524251e7-77ce-4eaf-bac6-63a52306cceb" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-524251e7-77ce-4eaf-bac6-63a52306cceb" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7141a1a4-9cee-46f1-8dd5-217b47cdbae7]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:11 devstack sudo[87395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb
Apr 14 01:24:11 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:11 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b" returned: 0 in 0.436s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG cinder.volume.volume_utils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Attempting download of e868e97b-1f2a-4ab6-b767-6d5c40d5e10c ((None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}])) to volume 592bb0df-f589-4471-9869-abe5634d9a7b. {{(pid=81812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0082a9b-99a7-4a03-bb7b-e46f15730f98]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_5vhgnv_0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:11 devstack sudo[87398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_5vhgnv_0
Apr 14 01:24:11 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:11 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb" returned: 0 in 0.536s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:11 devstack sudo[87403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb
Apr 14 01:24:11 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:12 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_5vhgnv_0" returned: 0 in 0.532s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_5vhgnv_0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:12 devstack sudo[87409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_5vhgnv_0
Apr 14 01:24:12 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:12 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-524251e7-77ce-4eaf-bac6-63a52306cceb" returned: 0 in 0.503s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-524251e7-77ce-4eaf-bac6-63a52306cceb" released by "delete_volume" :: held 1.076s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Created reservations ['9a311ac5-9f91-4c30-96bb-f65e54a2fffb', '3f0ed2eb-15b5-4508-9353-a13a7acc858b', '7921da78-a102-42f2-ad72-a76c49a0909a', '59e4b624-b0bd-4ac7-8a34-22a31d0e419d'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:12 devstack sudo[87411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:12 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:12 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_5vhgnv_0" returned: 1 in 0.588s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_5vhgnv_0' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d7ed9f-f693-42bf-bc83-1c001bd8c2ba]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kfsuc5n3devstack@QuobyteHD {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:12 devstack sudo[87415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kfsuc5n3devstack@QuobyteHD
Apr 14 01:24:12 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:12 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.573s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:12 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Deleted volume successfully.
Apr 14 01:24:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-aed7efb0-8cf4-4a66-a32a-5703b62b7e0c tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-524251e7-77ce-4eaf-bac6-63a52306cceb-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:13 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kfsuc5n3devstack@QuobyteHD" returned: 0 in 0.569s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] e868e97b-1f2a-4ab6-b767-6d5c40d5e10c was qcow2, converting to raw {{(pid=81812) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kfsuc5n3devstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-1143f733-6f47-45f0-922b-3d947040f69b-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:13 devstack sudo[87421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kfsuc5n3devstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b
Apr 14 01:24:13 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-1143f733-6f47-45f0-922b-3d947040f69b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-f1ab5db3-508b-42fb-a5b3-a37bd3716789" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-f1ab5db3-508b-42fb-a5b3-a37bd3716789" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-1143f733-6f47-45f0-922b-3d947040f69b" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-1143f733-6f47-45f0-922b-3d947040f69b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Deleting offline snapshot 1143f733-6f47-45f0-922b-3d947040f69b of volume f1ab5db3-508b-42fb-a5b3-a37bd3716789 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] snapshot_file for this snap is: volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cec727-1316-4688-8395-50dba4608393]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:13 devstack sudo[87423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b
Apr 14 01:24:13 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:13 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b" returned: 0 in 0.574s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c24d1b-65c6-42fe-b3d7-d38a0988c882]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:14 devstack sudo[87466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789
Apr 14 01:24:14 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:14 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kfsuc5n3devstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b" returned: 0 in 1.062s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:14 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_kfsuc5n3devstack@QuobyteHD, size 112.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:24:14 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Converted 112.00 MB image at 105.34 MB/s
Apr 14 01:24:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:14 devstack sudo[87469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b 1G
Apr 14 01:24:14 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:14 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789" returned: 0 in 0.658s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:14 devstack sudo[87474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b
Apr 14 01:24:14 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:14 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b 1G" returned: 0 in 0.515s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:14 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f11103-cd47-45cf-a229-e909615a42df]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:14 devstack sudo[87479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b
Apr 14 01:24:14 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:15 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b" returned: 0 in 0.569s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:15 devstack sudo[87484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b
Apr 14 01:24:15 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Flow 'volume_create_manager' (124edd62-a193-4abc-8e0a-5061bd6a680e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8a224c-15a9-4bc6-bfcd-5dc217fb4719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8a224c-15a9-4bc6-bfcd-5dc217fb4719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-780762588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd0398b-272b-4d55-aa43-e6a65a58f7be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6b342be5cc404ca846796f88e2aeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:15Z,use_quota=True,user_id='7ab43840da2a4c378d52c26fb96a57c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ecac261-d965-4959-95dd-963b8b2e1e5c),volume_type_id=3ecac261-d965-4959-95dd-963b8b2e1e5c)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094e59c0-32d3-493d-8450-954f6378e76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094e59c0-32d3-493d-8450-954f6378e76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef3829a-14ff-433d-ae27-c61f79c7ddd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef3829a-14ff-433d-ae27-c61f79c7ddd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cd0398b-272b-4d55-aa43-e6a65a58f7be', 'volume_name': 'volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd60cc1e-1544-48e9-b594-c8e9da85a428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd60cc1e-1544-48e9-b594-c8e9da85a428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413d8872-dcbc-4e93-b5f6-b0fac75d342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:15 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Volume 8cd0398b-272b-4d55-aa43-e6a65a58f7be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be', 'volume_size': 1}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-780762588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd0398b-272b-4d55-aa43-e6a65a58f7be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6b342be5cc404ca846796f88e2aeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:15Z,use_quota=True,user_id='7ab43840da2a4c378d52c26fb96a57c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ecac261-d965-4959-95dd-963b8b2e1e5c),volume_type_id=3ecac261-d965-4959-95dd-963b8b2e1e5c)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Creating volume 8cd0398b-272b-4d55-aa43-e6a65a58f7be {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:24:15 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:15 devstack sudo[87488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be 1073741824
Apr 14 01:24:15 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:15 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b" returned: 0 in 0.579s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:15 devstack sudo[87490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b
Apr 14 01:24:15 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:15 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789.1143f733-6f47-45f0-922b-3d947040f69b" returned: 0 in 0.508s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-1143f733-6f47-45f0-922b-3d947040f69b" released by "_delete_snapshot" :: held 2.366s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-f1ab5db3-508b-42fb-a5b3-a37bd3716789" released by "delete_snapshot" :: held 2.385s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Created reservations ['1e6ba63f-0b31-419d-b68a-8cf229cbd4ca', '8d095c96-2240-4c4b-be7b-dbe0de1fd2d6', '0cc49385-e5fa-4473-8c0a-78de3b6fa342', '87c0316c-bb96-4699-8d21-6daed3dd0f8d'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:15 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Delete snapshot completed successfully.
Apr 14 01:24:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-625f1c18-7418-46a1-a6da-8584954a4ab9 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-1143f733-6f47-45f0-922b-3d947040f69b-delete_snapshot" released by "delete_snapshot" :: held 2.486s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:16 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be 1073741824" returned: 0 in 0.574s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:16 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b" returned: 1 in 0.553s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.volume.volume_utils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Downloaded image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c ((None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}])) to volume 592bb0df-f589-4471-9869-abe5634d9a7b successfully. {{(pid=81812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Temporary image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c for user 5cc7174a4e844722b7e243f2444d39ea is deleted. {{(pid=81812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.volume.volume_utils [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Marking volume 592bb0df-f589-4471-9869-abe5634d9a7b as bootable. {{(pid=81812) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 14 01:24:16 devstack sudo[87499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be
Apr 14 01:24:16 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Copying metadata from image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c to 592bb0df-f589-4471-9869-abe5634d9a7b. {{(pid=81812) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Creating volume glance metadata for volume 592bb0df-f589-4471-9869-abe5634d9a7b backed by image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81812) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50023419-87d0-4656-ab7b-eaf7045bd9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592bb0df-f589-4471-9869-abe5634d9a7b', 'volume_size': 1, 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '632509b247064588826fa463262eaec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'created_at': datetime.datetime(2026, 4, 13, 23, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 23, 14, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f70df38c1c0>}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230f971b-0fbd-48fc-8a42-008473807a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:16 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Volume volume-592bb0df-f589-4471-9869-abe5634d9a7b (592bb0df-f589-4471-9869-abe5634d9a7b): created successfully
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230f971b-0fbd-48fc-8a42-008473807a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Flow 'volume_create_manager' (96c3e19b-cc96-47ac-bcc1-a58a094ff93a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:16 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-36cf680a-9e15-4ba1-9314-6fd200d9fd5b tempest-VolumesExtendTest-2015274524 None] Created volume successfully.
Apr 14 01:24:16 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be" returned: 0 in 0.449s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413d8872-dcbc-4e93-b5f6-b0fac75d342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b91840-a8f3-43f4-aa4f-1c0071c31379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:16 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Volume volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be (8cd0398b-272b-4d55-aa43-e6a65a58f7be): created successfully
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b91840-a8f3-43f4-aa4f-1c0071c31379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Flow 'volume_create_manager' (124edd62-a193-4abc-8e0a-5061bd6a680e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-f1ab5db3-508b-42fb-a5b3-a37bd3716789-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:16 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d63b4dd2-0f67-4662-a254-272852d00359 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Created volume successfully.
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-f1ab5db3-508b-42fb-a5b3-a37bd3716789-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-f1ab5db3-508b-42fb-a5b3-a37bd3716789" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-f1ab5db3-508b-42fb-a5b3-a37bd3716789" acquired by "delete_volume" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7c3052-a145-4f96-8c86-5bba2695b9b3]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:16 devstack sudo[87502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789
Apr 14 01:24:16 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-16e4db06-2aac-49c9-99d9-fe7eab8384d4 tempest-VolumesExtendTest-2015274524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-16e4db06-2aac-49c9-99d9-fe7eab8384d4 tempest-VolumesExtendTest-2015274524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ee0f67-2701-44b7-8526-7015d1772111]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-16e4db06-2aac-49c9-99d9-fe7eab8384d4 tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:17 devstack sudo[87507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b
Apr 14 01:24:17 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:17 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789" returned: 0 in 0.512s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:17 devstack sudo[87509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789
Apr 14 01:24:17 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:17 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:17 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f1ab5db3-508b-42fb-a5b3-a37bd3716789" returned: 0 in 0.455s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-16e4db06-2aac-49c9-99d9-fe7eab8384d4 tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b" returned: 0 in 0.539s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-16e4db06-2aac-49c9-99d9-fe7eab8384d4 tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-f1ab5db3-508b-42fb-a5b3-a37bd3716789" released by "delete_volume" :: held 1.013s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Created reservations ['f739e085-38bb-41dc-9a79-136c96a8fabc', 'ea6c36b4-984f-4e0e-9f4b-2f2c0c33ef4c', '13098a72-cbfc-47cb-95d2-5028d1327d76', 'e5e4b92f-348b-4396-9d37-39fa18fe755b'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:17 devstack sudo[87515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b
Apr 14 01:24:17 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:17 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:17 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3be4d446-3379-4e1a-b984-33c34c7e73d8 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3be4d446-3379-4e1a-b984-33c34c7e73d8 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3be4d446-3379-4e1a-b984-33c34c7e73d8 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3be4d446-3379-4e1a-b984-33c34c7e73d8 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3be4d446-3379-4e1a-b984-33c34c7e73d8 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3be4d446-3379-4e1a-b984-33c34c7e73d8 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:17 devstack sudo[87519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:17 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:18 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-16e4db06-2aac-49c9-99d9-fe7eab8384d4 tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b" returned: 1 in 0.545s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-16e4db06-2aac-49c9-99d9-fe7eab8384d4 tempest-VolumesExtendTest-2015274524 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-16e4db06-2aac-49c9-99d9-fe7eab8384d4 tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b 2G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:18 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.469s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:18 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Deleted volume successfully.
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9a70b00e-d114-4871-88c4-252217b1723b tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-f1ab5db3-508b-42fb-a5b3-a37bd3716789-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-16e4db06-2aac-49c9-99d9-fe7eab8384d4 tempest-VolumesExtendTest-2015274524 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b 2G" returned: 0 in 0.055s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-16e4db06-2aac-49c9-99d9-fe7eab8384d4 tempest-VolumesExtendTest-2015274524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.168s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:18 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-16e4db06-2aac-49c9-99d9-fe7eab8384d4 tempest-VolumesExtendTest-2015274524 None] Extend volume completed successfully.
Apr 14 01:24:18 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3be4d446-3379-4e1a-b984-33c34c7e73d8 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.443s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-3be4d446-3379-4e1a-b984-33c34c7e73d8 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:18 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3be4d446-3379-4e1a-b984-33c34c7e73d8 tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Retype volume completed successfully.
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-6a4b1c9c-3843-4310-b6c0-f18c20da7980-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-6a4b1c9c-3843-4310-b6c0-f18c20da7980-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "cinder-quobyte-6a4b1c9c-3843-4310-b6c0-f18c20da7980" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-6a4b1c9c-3843-4310-b6c0-f18c20da7980" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5842b9bf-e9bf-4ae8-bbf6-e4e8ee627fac]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:18 devstack sudo[87529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980
Apr 14 01:24:18 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Acquiring lock "cinder-8cd0398b-272b-4d55-aa43-e6a65a58f7be-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Lock "cinder-8cd0398b-272b-4d55-aa43-e6a65a58f7be-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Acquiring lock "cinder-quobyte-8cd0398b-272b-4d55-aa43-e6a65a58f7be" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Lock "cinder-quobyte-8cd0398b-272b-4d55-aa43-e6a65a58f7be" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dba0c0-e016-48cf-a2d3-fdcb21685121]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:19 devstack sudo[87531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be
Apr 14 01:24:19 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Acquiring lock "cinder-592bb0df-f589-4471-9869-abe5634d9a7b-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:19 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980" returned: 0 in 0.496s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Lock "cinder-592bb0df-f589-4471-9869-abe5634d9a7b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:19 devstack sudo[87536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980
Apr 14 01:24:19 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Acquiring lock "cinder-quobyte-592bb0df-f589-4471-9869-abe5634d9a7b" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Lock "cinder-quobyte-592bb0df-f589-4471-9869-abe5634d9a7b" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6615ee0-f67a-4d89-82d4-8679e5a03dfd]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:19 devstack sudo[87538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b
Apr 14 01:24:19 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:19 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be" returned: 0 in 0.537s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:19 devstack sudo[87543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be
Apr 14 01:24:19 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:19 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6a4b1c9c-3843-4310-b6c0-f18c20da7980" returned: 0 in 0.435s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-quobyte-6a4b1c9c-3843-4310-b6c0-f18c20da7980" released by "delete_volume" :: held 0.963s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Created reservations ['2d177f47-386a-4751-9086-e526f7cbe83d', 'af3ca871-a092-4e4c-83b6-2980e0e07167', '040ab8f1-d9b5-4e65-a237-745a66c7deb9', 'd1ae6128-50c0-42fe-932c-9dd8b2033b73'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:19 devstack sudo[87548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:19 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:19 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b" returned: 0 in 0.522s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:19 devstack sudo[87550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b
Apr 14 01:24:19 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:20 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8cd0398b-272b-4d55-aa43-e6a65a58f7be" returned: 0 in 0.452s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Lock "cinder-quobyte-8cd0398b-272b-4d55-aa43-e6a65a58f7be" released by "delete_volume" :: held 1.017s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:20 devstack cinder-volume[81812]: WARNING cinder.quota [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:24:20 devstack cinder-volume[81812]: WARNING cinder.quota [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Created reservations ['4bd35622-f76e-4196-9ae4-8dc1e042b7d3', '79228588-2313-4355-80e9-a93c5eba6321', 'c414e299-3908-4673-b363-56657487e184', '8b41a45a-3511-4529-84c6-ac09174c2ea8'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:20 devstack sudo[87553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:20 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:20 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.455s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:20 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Deleted volume successfully.
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-16aa6721-979f-47c1-b1bb-f86f9b3623d0 tempest-VolumesSnapshotTestJSON-869685304 None] Lock "cinder-6a4b1c9c-3843-4310-b6c0-f18c20da7980-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:20 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b" returned: 1 in 0.621s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:20 devstack sudo[87559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b
Apr 14 01:24:20 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:20 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.503s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:20 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Deleted volume successfully.
Apr 14 01:24:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e1b22ec0-61a5-4244-a4b6-d9ae743ccb1e tempest-VolumeRetypeWithoutMigrationTest-375115595 None] Lock "cinder-8cd0398b-272b-4d55-aa43-e6a65a58f7be-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:21 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-592bb0df-f589-4471-9869-abe5634d9a7b" returned: 0 in 0.489s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Lock "cinder-quobyte-592bb0df-f589-4471-9869-abe5634d9a7b" released by "delete_volume" :: held 1.673s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Created reservations ['1bbbd437-e46a-4b8b-80be-05fdfb79a272', 'a0e6ba18-caf1-4d15-8153-667cc762a353', '799166af-4e0b-46cd-8e51-a483be556ef4', '72b6fc49-6151-4cc9-89e5-dea77fd08a3f'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:21 devstack sudo[87564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:21 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:21 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.475s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:21 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Deleted volume successfully.
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-42cbf3aa-e9b1-417e-a043-75da0bbefbcb tempest-VolumesExtendTest-2015274524 None] Lock "cinder-592bb0df-f589-4471-9869-abe5634d9a7b-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Flow 'volume_create_manager' (adb2fe54-473e-4100-a41d-fc2b38c6bf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c381d4-d0cc-4447-819e-b09e6bfc9e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c381d4-d0cc-4447-819e-b09e6bfc9e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1491784645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69683132-1ad3-4f08-952c-bc0985401429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c75259f4e342d1b7e793b4bdcd36a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:22Z,use_quota=True,user_id='5cc7174a4e844722b7e243f2444d39ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb4f99d-3087-4785-8d70-60d24c156a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb4f99d-3087-4785-8d70-60d24c156a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7479f050-13cf-43d9-8ec6-3a5985e30c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7479f050-13cf-43d9-8ec6-3a5985e30c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69683132-1ad3-4f08-952c-bc0985401429', 'volume_name': 'volume-69683132-1ad3-4f08-952c-bc0985401429', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b0f818-fcf6-4361-b3e9-cc2268818b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b0f818-fcf6-4361-b3e9-cc2268818b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2014977-1e63-4269-b7c6-71043b481bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:21 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Volume 69683132-1ad3-4f08-952c-bc0985401429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69683132-1ad3-4f08-952c-bc0985401429', 'volume_size': 1}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1491784645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69683132-1ad3-4f08-952c-bc0985401429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c75259f4e342d1b7e793b4bdcd36a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:22Z,use_quota=True,user_id='5cc7174a4e844722b7e243f2444d39ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Creating volume 69683132-1ad3-4f08-952c-bc0985401429 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:24:21 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:24:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:21 devstack sudo[87567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429 1073741824
Apr 14 01:24:21 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:22 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429 1073741824" returned: 0 in 0.689s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:22 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429
Apr 14 01:24:22 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:23 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429" returned: 0 in 0.566s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:23 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:24:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2014977-1e63-4269-b7c6-71043b481bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69683132-1ad3-4f08-952c-bc0985401429', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cccb603a-4ec2-4b35-815e-779c4344343d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:23 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Volume volume-69683132-1ad3-4f08-952c-bc0985401429 (69683132-1ad3-4f08-952c-bc0985401429): created successfully
Apr 14 01:24:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cccb603a-4ec2-4b35-815e-779c4344343d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Flow 'volume_create_manager' (adb2fe54-473e-4100-a41d-fc2b38c6bf61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:23 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-1b759bd8-5d12-4358-aff8-e50314cb0dd6 tempest-VolumesExtendTest-2015274524 None] Created volume successfully.
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] Creating offline snapshot 182903a7-d7cf-413d-b0fd-dc618be00265 of volume 69683132-1ad3-4f08-952c-bc0985401429 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[282b0655-42fe-4994-8f7a-1fe8809ce2a0]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:24 devstack sudo[87576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429
Apr 14 01:24:24 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Flow 'volume_create_manager' (df214b9d-9dea-4452-bb08-0ed7ccf7c29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86eec22-072e-4b1d-836d-0a1179517a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86eec22-072e-4b1d-836d-0a1179517a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-187651081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54af069-56a7-4085-b5ac-137a4415d4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21b1d0ca6fd44358d2aa6676d7ef6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:24Z,use_quota=True,user_id='c8fb6f7a18c248f5bc7b815398d4af5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd824e8-29a0-47e5-9a3d-117e465ccbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd824e8-29a0-47e5-9a3d-117e465ccbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b924f13b-e8cd-49af-86e4-7429655cd1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b924f13b-e8cd-49af-86e4-7429655cd1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c54af069-56a7-4085-b5ac-137a4415d4fd', 'volume_name': 'volume-c54af069-56a7-4085-b5ac-137a4415d4fd', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05bcb87-8424-4386-9d8c-7fd5eb523de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05bcb87-8424-4386-9d8c-7fd5eb523de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d742d9c-5e9b-44f1-8264-c2a344ca2d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:24 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Volume c54af069-56a7-4085-b5ac-137a4415d4fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c54af069-56a7-4085-b5ac-137a4415d4fd', 'volume_size': 1}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Flow 'volume_create_manager' (670c576c-1aff-4388-89d3-2d022630a9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47e2e33-3160-4edf-ae37-50c91c53d503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47e2e33-3160-4edf-ae37-50c91c53d503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-827298554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3103af8-9c69-4187-8dd5-ddee04ac0324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fbc84c2d34f46338ec947b1702e193b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:24Z,use_quota=True,user_id='7936f39a3683430f944310c27042afed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e268672-3910-4bda-98d2-7b74ff95ab1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e268672-3910-4bda-98d2-7b74ff95ab1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514b3298-6b98-4211-98f2-4a9914322932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.image.glance [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Creating Keystone auth plugin from conf {{(pid=81812) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 14 01:24:24 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429" returned: 0 in 0.580s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:24 devstack sudo[87581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265 1G
Apr 14 01:24:24 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514b3298-6b98-4211-98f2-4a9914322932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3103af8-9c69-4187-8dd5-ddee04ac0324', 'volume_name': 'volume-b3103af8-9c69-4187-8dd5-ddee04ac0324', 'volume_size': 1, 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '632509b247064588826fa463262eaec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'created_at': datetime.datetime(2026, 4, 13, 23, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 23, 14, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f70df22c910>}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc390ad-1d8b-42c9-97e8-7c601fe38cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc390ad-1d8b-42c9-97e8-7c601fe38cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d06fe27-931b-4977-9220-8a61516b2a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:24 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Volume b3103af8-9c69-4187-8dd5-ddee04ac0324: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3103af8-9c69-4187-8dd5-ddee04ac0324', 'volume_size': 1, 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '632509b247064588826fa463262eaec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'created_at': datetime.datetime(2026, 4, 13, 23, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 23, 14, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f70df22c910>}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Trying to clone b3103af8-9c69-4187-8dd5-ddee04ac0324 from image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c at location (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]). {{(pid=81812) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_uwf32e6udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81812) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 14 01:24:24 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Image download 20.69 MB at 20.69 MB/s
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c64ce47-848e-494d-9ce0-8b17cb52136e]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_uwf32e6udevstack@QuobyteHD {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:24 devstack sudo[87584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_uwf32e6udevstack@QuobyteHD
Apr 14 01:24:24 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:25 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265 1G" returned: 0 in 0.492s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69683132-1ad3-4f08-952c-bc0985401429 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:25 devstack sudo[87589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69683132-1ad3-4f08-952c-bc0985401429 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265
Apr 14 01:24:25 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:25 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_uwf32e6udevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:25 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Temporary image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c is fetched for user 7936f39a3683430f944310c27042afed. {{(pid=81812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 14 01:24:25 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[114a67ff-86c3-4842-a520-d2468aa4c009]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_uwf32e6udevstack@QuobyteHD {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:25 devstack sudo[87594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_uwf32e6udevstack@QuobyteHD
Apr 14 01:24:25 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:25 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69683132-1ad3-4f08-952c-bc0985401429 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265" returned: 0 in 0.481s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:25 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265 is being set with open permissions: ugo+rw
Apr 14 01:24:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:25 devstack sudo[87599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265
Apr 14 01:24:25 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:25 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_uwf32e6udevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:25 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265" returned: 0 in 0.414s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:26 devstack sudo[87605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.info
Apr 14 01:24:26 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:26 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.info" returned: 0 in 0.430s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:26 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.info is being set with open permissions: ugo+rw
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:26 devstack sudo[87608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.info
Apr 14 01:24:26 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:26 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.info" returned: 0 in 0.405s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.862s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.594s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-187651081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54af069-56a7-4085-b5ac-137a4415d4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21b1d0ca6fd44358d2aa6676d7ef6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:24Z,use_quota=True,user_id='c8fb6f7a18c248f5bc7b815398d4af5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Creating volume c54af069-56a7-4085-b5ac-137a4415d4fd {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:24:26 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:24:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:26 devstack sudo[87611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd 1073741824
Apr 14 01:24:26 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-7783058b-ab7d-4e08-9a7d-fee125f6449d tempest-VolumesExtendTest-2015274524 None] Create snapshot completed successfully
Apr 14 01:24:26 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3828472e-45e7-4c44-983e-dc8d6cf9997e tempest-VolumesExtendTest-2015274524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:27 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd 1073741824" returned: 0 in 0.538s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:27 devstack sudo[87617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd
Apr 14 01:24:27 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:27 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd" returned: 0 in 0.405s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.026s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-827298554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3103af8-9c69-4187-8dd5-ddee04ac0324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fbc84c2d34f46338ec947b1702e193b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:24Z,use_quota=True,user_id='7936f39a3683430f944310c27042afed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Creating volume b3103af8-9c69-4187-8dd5-ddee04ac0324 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:24:27 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d742d9c-5e9b-44f1-8264-c2a344ca2d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54af069-56a7-4085-b5ac-137a4415d4fd', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:27 devstack sudo[87620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 1073741824
Apr 14 01:24:27 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cffa1f0e-9a81-4a41-acc4-e72c6c039058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:27 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Volume volume-c54af069-56a7-4085-b5ac-137a4415d4fd (c54af069-56a7-4085-b5ac-137a4415d4fd): created successfully
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cffa1f0e-9a81-4a41-acc4-e72c6c039058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Flow 'volume_create_manager' (df214b9d-9dea-4452-bb08-0ed7ccf7c29f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:27 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b1aaf457-291d-477f-8528-1294934498c5 tempest-VolumeDependencyTests-2026088499 None] Created volume successfully.
Apr 14 01:24:28 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 1073741824" returned: 0 in 0.477s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:28 devstack sudo[87625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324
Apr 14 01:24:28 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:28 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324" returned: 0 in 0.433s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:28 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:24:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3828472e-45e7-4c44-983e-dc8d6cf9997e tempest-VolumesExtendTest-2015274524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.423s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:28 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6b9a8b-2862-4653-bfff-bd88ffae62ab]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3828472e-45e7-4c44-983e-dc8d6cf9997e tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:28 devstack cinder-volume[81812]: DEBUG cinder.volume.volume_utils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Attempting download of e868e97b-1f2a-4ab6-b767-6d5c40d5e10c ((None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}])) to volume b3103af8-9c69-4187-8dd5-ddee04ac0324. {{(pid=81812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 14 01:24:28 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[acff9b56-3902-491f-8db5-523ef486381b]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_599udnei {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:28 devstack sudo[87628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429
Apr 14 01:24:28 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:28 devstack sudo[87629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_599udnei
Apr 14 01:24:28 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:29 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3828472e-45e7-4c44-983e-dc8d6cf9997e tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429" returned: 0 in 0.480s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3828472e-45e7-4c44-983e-dc8d6cf9997e tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265 2G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:29 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_599udnei" returned: 0 in 0.449s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_599udnei {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3828472e-45e7-4c44-983e-dc8d6cf9997e tempest-VolumesExtendTest-2015274524 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265 2G" returned: 0 in 0.067s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3828472e-45e7-4c44-983e-dc8d6cf9997e tempest-VolumesExtendTest-2015274524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.562s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.801s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] Creating offline snapshot 26278484-2c1b-42f7-b4a7-35b3f7663616 of volume c54af069-56a7-4085-b5ac-137a4415d4fd {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:24:29 devstack sudo[87639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_599udnei
Apr 14 01:24:29 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f593b0c-695d-43d6-8c7b-ff8a6a1dc0e8]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:29 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3828472e-45e7-4c44-983e-dc8d6cf9997e tempest-VolumesExtendTest-2015274524 None] Extend volume completed successfully.
Apr 14 01:24:29 devstack sudo[87642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd
Apr 14 01:24:29 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Acquiring lock "cinder-182903a7-d7cf-413d-b0fd-dc618be00265-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Lock "cinder-182903a7-d7cf-413d-b0fd-dc618be00265-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Acquiring lock "cinder-quobyte-69683132-1ad3-4f08-952c-bc0985401429" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Lock "cinder-quobyte-69683132-1ad3-4f08-952c-bc0985401429" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Acquiring lock "cinder-quobyte-182903a7-d7cf-413d-b0fd-dc618be00265" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Lock "cinder-quobyte-182903a7-d7cf-413d-b0fd-dc618be00265" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Deleting offline snapshot 182903a7-d7cf-413d-b0fd-dc618be00265 of volume 69683132-1ad3-4f08-952c-bc0985401429 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] snapshot_file for this snap is: volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f58ed90-11d9-4bb4-a333-214043f7bb75]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:29 devstack sudo[87644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265
Apr 14 01:24:29 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:29 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_599udnei" returned: 1 in 0.484s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_599udnei' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fe1ea0-2334-4f42-a689-7e0dd5d0cd32]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_uwf32e6udevstack@QuobyteHD {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:29 devstack sudo[87648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_uwf32e6udevstack@QuobyteHD
Apr 14 01:24:29 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:29 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd" returned: 0 in 0.529s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:29 devstack sudo[87653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616 1G
Apr 14 01:24:29 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:30 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265" returned: 0 in 0.467s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:30 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69683132-1ad3-4f08-952c-bc0985401429(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:24:30 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b966471d-a94e-447a-abb9-317ae50fdafb]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:30 devstack sudo[87658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429
Apr 14 01:24:30 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:30 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_uwf32e6udevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:30 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] e868e97b-1f2a-4ab6-b767-6d5c40d5e10c was qcow2, converting to raw {{(pid=81812) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 14 01:24:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_uwf32e6udevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:30 devstack sudo[87665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_uwf32e6udevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324
Apr 14 01:24:30 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:30 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616 1G" returned: 0 in 0.469s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c54af069-56a7-4085-b5ac-137a4415d4fd -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:30 devstack sudo[87668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c54af069-56a7-4085-b5ac-137a4415d4fd -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616
Apr 14 01:24:30 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:30 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429" returned: 0 in 0.501s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:30 devstack sudo[87676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265
Apr 14 01:24:30 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:30 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c54af069-56a7-4085-b5ac-137a4415d4fd -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616" returned: 0 in 0.497s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:30 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616 is being set with open permissions: ugo+rw
Apr 14 01:24:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:30 devstack sudo[87690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616
Apr 14 01:24:30 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:31 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_uwf32e6udevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324" returned: 0 in 0.870s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_uwf32e6udevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:24:31 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Converted 112.00 MB image at 112.00 MB/s
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:31 devstack sudo[87695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 1G
Apr 14 01:24:31 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:31 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265" returned: 0 in 0.554s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:31 devstack sudo[87697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265
Apr 14 01:24:31 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:31 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616" returned: 0 in 0.444s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:31 devstack sudo[87700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.info
Apr 14 01:24:31 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:31 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 1G" returned: 0 in 0.434s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4019f20d-2f3c-451a-9841-b2b3b9944f2e]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:31 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429.182903a7-d7cf-413d-b0fd-dc618be00265" returned: 0 in 0.433s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Lock "cinder-quobyte-182903a7-d7cf-413d-b0fd-dc618be00265" released by "_delete_snapshot" :: held 2.012s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Lock "cinder-quobyte-69683132-1ad3-4f08-952c-bc0985401429" released by "delete_snapshot" :: held 2.026s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:31 devstack sudo[87706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324
Apr 14 01:24:31 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Created reservations ['47272cb1-8aea-4d47-a6f4-c8d789872f72', 'c2be0987-f787-4aa6-83a8-e9ecac592a08', '64a31dcd-75f3-4dda-82d6-b68626ede4d5', 'a0b0c777-2ee8-468a-a151-83ed5aa63385'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:31 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Delete snapshot completed successfully.
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c1768a03-5379-4ce9-93c8-668ea5391e40 tempest-VolumesExtendTest-2015274524 None] Lock "cinder-182903a7-d7cf-413d-b0fd-dc618be00265-delete_snapshot" released by "delete_snapshot" :: held 2.141s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:31 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.info" returned: 0 in 0.480s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:31 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.info is being set with open permissions: ugo+rw
Apr 14 01:24:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:31 devstack sudo[87709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.info
Apr 14 01:24:31 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:32 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324" returned: 0 in 0.479s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:32 devstack sudo[87713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324
Apr 14 01:24:32 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:32 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.info" returned: 0 in 0.405s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.886s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:32 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-266d0a9e-3ba4-471e-ae6d-a5ae781cf50f tempest-VolumeDependencyTests-2026088499 None] Create snapshot completed successfully
Apr 14 01:24:32 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324" returned: 1 in 0.474s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG cinder.volume.volume_utils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Downloaded image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c ((None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}])) to volume b3103af8-9c69-4187-8dd5-ddee04ac0324 successfully. {{(pid=81812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Temporary image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c for user 7936f39a3683430f944310c27042afed is deleted. {{(pid=81812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG cinder.volume.volume_utils [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Marking volume b3103af8-9c69-4187-8dd5-ddee04ac0324 as bootable. {{(pid=81812) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Copying metadata from image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c to b3103af8-9c69-4187-8dd5-ddee04ac0324. {{(pid=81812) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Creating volume glance metadata for volume b3103af8-9c69-4187-8dd5-ddee04ac0324 backed by image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81812) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d06fe27-931b-4977-9220-8a61516b2a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3103af8-9c69-4187-8dd5-ddee04ac0324', 'volume_size': 1, 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '632509b247064588826fa463262eaec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'created_at': datetime.datetime(2026, 4, 13, 23, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 23, 14, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f70df22c910>}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47e9a05-b398-4109-b99e-2efec81e34b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:32 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Volume volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 (b3103af8-9c69-4187-8dd5-ddee04ac0324): created successfully
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47e9a05-b398-4109-b99e-2efec81e34b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Flow 'volume_create_manager' (670c576c-1aff-4388-89d3-2d022630a9b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:32 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-fe916d4b-1d1b-44c0-8e1e-26e232e894c6 tempest-VolumesImageMetadata-854344931 None] Created volume successfully.
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Acquiring lock "cinder-69683132-1ad3-4f08-952c-bc0985401429-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Lock "cinder-69683132-1ad3-4f08-952c-bc0985401429-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Acquiring lock "cinder-quobyte-69683132-1ad3-4f08-952c-bc0985401429" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Lock "cinder-quobyte-69683132-1ad3-4f08-952c-bc0985401429" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeaba15-1eb7-4683-8182-a2cfd36f89fc]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:32 devstack sudo[87719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429
Apr 14 01:24:32 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Flow 'volume_create_manager' (a67f71fa-42d2-4f2f-8ea7-ca8d67ee6edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dbd5db-42b3-4303-bc15-525e4340e612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dbd5db-42b3-4303-bc15-525e4340e612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1624394577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c2d2bda-5c93-4810-afcc-2112d0d355e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21b1d0ca6fd44358d2aa6676d7ef6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=26278484-2c1b-42f7-b4a7-35b3f7663616,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:33Z,use_quota=True,user_id='c8fb6f7a18c248f5bc7b815398d4af5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7211db-acac-4a88-8b26-7cb6f642adfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7211db-acac-4a88-8b26-7cb6f642adfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acdde28-453a-427e-bbbb-01261fb163fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acdde28-453a-427e-bbbb-01261fb163fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9c2d2bda-5c93-4810-afcc-2112d0d355e5', 'volume_name': 'volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5', 'volume_size': 1, 'snapshot_id': '26278484-2c1b-42f7-b4a7-35b3f7663616'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79be6d7a-48bb-4724-b535-bf1d86544017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79be6d7a-48bb-4724-b535-bf1d86544017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d411cd2-0b59-47ad-90c7-217d80e91ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:33 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Volume 9c2d2bda-5c93-4810-afcc-2112d0d355e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5', 'volume_size': 1, 'snapshot_id': '26278484-2c1b-42f7-b4a7-35b3f7663616'}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-quobyte-26278484-2c1b-42f7-b4a7-35b3f7663616-9c2d2bda-5c93-4810-afcc-2112d0d355e5" by "_create_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-26278484-2c1b-42f7-b4a7-35b3f7663616-9c2d2bda-5c93-4810-afcc-2112d0d355e5" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Creating volume 9c2d2bda-5c93-4810-afcc-2112d0d355e5 from snapshot 26278484-2c1b-42f7-b4a7-35b3f7663616 {{(pid=81812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-quobyte-9c2d2bda-5c93-4810-afcc-2112d0d355e5" by "_copy_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-9c2d2bda-5c93-4810-afcc-2112d0d355e5" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] snapshot: 26278484-2c1b-42f7-b4a7-35b3f7663616, volume: 9c2d2bda-5c93-4810-afcc-2112d0d355e5,  {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[919859dc-c1df-4e69-8940-8590a6112859]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Acquiring lock "cinder-b3103af8-9c69-4187-8dd5-ddee04ac0324-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Lock "cinder-b3103af8-9c69-4187-8dd5-ddee04ac0324-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Acquiring lock "cinder-quobyte-b3103af8-9c69-4187-8dd5-ddee04ac0324" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Lock "cinder-quobyte-b3103af8-9c69-4187-8dd5-ddee04ac0324" acquired by "delete_volume" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:33 devstack sudo[87721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616
Apr 14 01:24:33 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb55c9d4-bcd0-4c09-b742-8f561a538c9f]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:33 devstack sudo[87723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324
Apr 14 01:24:33 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:33 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429" returned: 0 in 0.539s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:33 devstack sudo[87728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429
Apr 14 01:24:33 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:33 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616" returned: 0 in 0.498s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c54af069-56a7-4085-b5ac-137a4415d4fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Creating direct copy from snapshot {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4507014d-f549-4ca2-a76c-77093b69c110]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:33 devstack sudo[87734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd
Apr 14 01:24:33 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:33 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324" returned: 0 in 0.500s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:33 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-69683132-1ad3-4f08-952c-bc0985401429" returned: 0 in 0.417s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:33 devstack sudo[87738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324
Apr 14 01:24:33 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Lock "cinder-quobyte-69683132-1ad3-4f08-952c-bc0985401429" released by "delete_volume" :: held 0.996s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Created reservations ['59b2723b-75b3-415b-8820-191ae416698c', '9327961d-74af-4d54-8b5d-d7767b62d12e', 'aed01903-8bf1-4875-8666-7e15eba2c0b1', '4fd82c98-da55-4ab2-99d1-74a72546d409'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:33 devstack sudo[87740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:33 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:34 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd" returned: 0 in 0.516s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG cinder.utils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Path /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5 not found in is_blk_device check {{(pid=81812) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:34 devstack sudo[87746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5
Apr 14 01:24:34 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:34 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324" returned: 1 in 0.530s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:34 devstack sudo[87750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324
Apr 14 01:24:34 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:34 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.483s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:34 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Deleted volume successfully.
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-de70bad3-a0c9-432d-9c92-947220a21b79 tempest-VolumesExtendTest-2015274524 None] Lock "cinder-69683132-1ad3-4f08-952c-bc0985401429-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:34 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b3103af8-9c69-4187-8dd5-ddee04ac0324" returned: 0 in 0.436s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Lock "cinder-quobyte-b3103af8-9c69-4187-8dd5-ddee04ac0324" released by "delete_volume" :: held 1.509s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Created reservations ['3fed69d5-4f2b-4cdf-816f-4464ad6c986c', '94c3f967-11c4-4a41-a6bf-afb6f2dabf82', '9914d9f8-6fa0-42eb-ba75-e3ca698ab8ae', '41bc5cd2-fd16-432f-8e32-027243bc4cb2'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:34 devstack sudo[87766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:34 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:36 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 1.098s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:36 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:36 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Deleted volume successfully.
Apr 14 01:24:36 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8debf9b9-fd92-41e7-b66f-a661715e2a2d tempest-VolumesImageMetadata-854344931 None] Lock "cinder-b3103af8-9c69-4187-8dd5-ddee04ac0324-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:36 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5" returned: 0 in 2.424s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:36 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bc5bb8-bc9d-4ef5-abe9-e74311d5026e]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:36 devstack sudo[87769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd
Apr 14 01:24:36 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Flow 'volume_create_manager' (b0d18208-558e-467d-bc55-2078d476a18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4b7f6a-f9b2-4eae-87bd-c366b73c00d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4b7f6a-f9b2-4eae-87bd-c366b73c00d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-328078278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2236e7714c924ad99f9fbf6984fb8737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:37Z,use_quota=True,user_id='0722d91f1d2d42f880060422c49bdecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9abcfc7-c4dd-43d8-952c-c717608a2916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9abcfc7-c4dd-43d8-952c-c717608a2916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dea907e-07b1-43f8-9d9d-d242f92a5975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dea907e-07b1-43f8-9d9d-d242f92a5975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc', 'volume_name': 'volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3435e4-369d-4cb6-abf5-ee8d787956e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:37 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3435e4-369d-4cb6-abf5-ee8d787956e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4933bb-4f8c-41f0-ab8b-5016a035647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:37 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Volume 1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc', 'volume_size': 1}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd" returned: 0 in 0.733s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5 {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:24:37 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Converted 1024.00 MB image at 422.27 MB/s
Apr 14 01:24:37 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5 is being set with open permissions: ugo+rw
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:37 devstack sudo[87774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5
Apr 14 01:24:37 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:37 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5" returned: 0 in 0.478s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-9c2d2bda-5c93-4810-afcc-2112d0d355e5" released by "_copy_volume_from_snapshot" :: held 4.709s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-26278484-2c1b-42f7-b4a7-35b3f7663616-9c2d2bda-5c93-4810-afcc-2112d0d355e5" released by "_create_volume_from_snapshot" :: held 4.724s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.734s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.509s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-328078278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2236e7714c924ad99f9fbf6984fb8737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:37Z,use_quota=True,user_id='0722d91f1d2d42f880060422c49bdecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Creating volume 1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:24:37 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:37 devstack sudo[87778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc 1073741824
Apr 14 01:24:37 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d411cd2-0b59-47ad-90c7-217d80e91ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5', 'volume_size': 1, 'snapshot_id': '26278484-2c1b-42f7-b4a7-35b3f7663616'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410b46d6-771a-4d56-ba1f-9048d22e6516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:37 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Volume volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5 (9c2d2bda-5c93-4810-afcc-2112d0d355e5): created successfully
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410b46d6-771a-4d56-ba1f-9048d22e6516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Flow 'volume_create_manager' (a67f71fa-42d2-4f2f-8ea7-ca8d67ee6edd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:37 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-12f06270-7869-4aa8-b98c-4f9c487f7f4e tempest-VolumeDependencyTests-2026088499 None] Created volume successfully.
Apr 14 01:24:37 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Flow 'volume_create_manager' (29bde0fb-7a9c-40fc-919c-e44212a41d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208af6c4-e214-4bff-bfca-4c6eb80a6fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208af6c4-e214-4bff-bfca-4c6eb80a6fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-433949886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69f914d-b87c-4356-91ae-9a34b52b35c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770c7297377d4ebc8d861d65c0373347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:38Z,use_quota=True,user_id='8e7330b09b8e4c58964848e8ac5446ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2859013-14b4-4920-be19-eeade47c648e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2859013-14b4-4920-be19-eeade47c648e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bea12b5-68f7-4416-8468-b0b85b0fc4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bea12b5-68f7-4416-8468-b0b85b0fc4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69f914d-b87c-4356-91ae-9a34b52b35c4', 'volume_name': 'volume-b69f914d-b87c-4356-91ae-9a34b52b35c4', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7141f73-ed6b-4972-9153-dec0804fb87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7141f73-ed6b-4972-9153-dec0804fb87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e973e1f7-62bf-431f-9159-a0865ef98e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:38 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Volume b69f914d-b87c-4356-91ae-9a34b52b35c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69f914d-b87c-4356-91ae-9a34b52b35c4', 'volume_size': 1}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:38 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc 1073741824" returned: 0 in 0.523s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:38 devstack sudo[87783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc
Apr 14 01:24:38 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-26278484-2c1b-42f7-b4a7-35b3f7663616-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-26278484-2c1b-42f7-b4a7-35b3f7663616-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-quobyte-c54af069-56a7-4085-b5ac-137a4415d4fd" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-c54af069-56a7-4085-b5ac-137a4415d4fd" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-quobyte-26278484-2c1b-42f7-b4a7-35b3f7663616" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-26278484-2c1b-42f7-b4a7-35b3f7663616" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Deleting offline snapshot 26278484-2c1b-42f7-b4a7-35b3f7663616 of volume c54af069-56a7-4085-b5ac-137a4415d4fd {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] snapshot_file for this snap is: volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[17908ebb-54f3-40e1-a862-8c2de9fd9720]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:38 devstack sudo[87785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616
Apr 14 01:24:38 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:38 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" returned: 0 in 0.439s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.783s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-433949886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69f914d-b87c-4356-91ae-9a34b52b35c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770c7297377d4ebc8d861d65c0373347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:38Z,use_quota=True,user_id='8e7330b09b8e4c58964848e8ac5446ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Creating volume b69f914d-b87c-4356-91ae-9a34b52b35c4 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:24:38 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b69f914d-b87c-4356-91ae-9a34b52b35c4 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4933bb-4f8c-41f0-ab8b-5016a035647d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:38 devstack sudo[87788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b69f914d-b87c-4356-91ae-9a34b52b35c4 1073741824
Apr 14 01:24:38 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f929fda0-f2fa-4fd5-bbd7-66144eee8da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:38 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Volume volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc (1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc): created successfully
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f929fda0-f2fa-4fd5-bbd7-66144eee8da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Flow 'volume_create_manager' (b0d18208-558e-467d-bc55-2078d476a18f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:38 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2e1badab-9d6b-466b-ac72-d2579ee111b1 tempest-VolumesSnapshotListTestJSON-854523724 None] Created volume successfully.
Apr 14 01:24:39 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616" returned: 0 in 0.487s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c54af069-56a7-4085-b5ac-137a4415d4fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef7abb1-47b6-4894-833d-260325d119fd]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:39 devstack sudo[87793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd
Apr 14 01:24:39 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:39 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b69f914d-b87c-4356-91ae-9a34b52b35c4 1073741824" returned: 0 in 0.502s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b69f914d-b87c-4356-91ae-9a34b52b35c4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:39 devstack sudo[87798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b69f914d-b87c-4356-91ae-9a34b52b35c4
Apr 14 01:24:39 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:39 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd" returned: 0 in 0.483s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:39 devstack sudo[87803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616
Apr 14 01:24:39 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:39 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b69f914d-b87c-4356-91ae-9a34b52b35c4" returned: 0 in 0.455s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.315s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] Creating offline snapshot ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 of volume 1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e973e1f7-62bf-431f-9159-a0865ef98e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69f914d-b87c-4356-91ae-9a34b52b35c4', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c836ab0-da96-4e90-91bc-cddab24ee6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0edfa27-10f1-4345-94ce-c05f9ec54a42]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:39 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Volume volume-b69f914d-b87c-4356-91ae-9a34b52b35c4 (b69f914d-b87c-4356-91ae-9a34b52b35c4): created successfully
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c836ab0-da96-4e90-91bc-cddab24ee6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Flow 'volume_create_manager' (29bde0fb-7a9c-40fc-919c-e44212a41d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:39 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-6d122d51-f168-4ef2-9831-a4717cd47b6f tempest-VolumesMetadataTest-1305041635 None] Created volume successfully.
Apr 14 01:24:39 devstack sudo[87809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc
Apr 14 01:24:39 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:39 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616" returned: 0 in 0.434s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:39 devstack sudo[87811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616
Apr 14 01:24:39 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:40 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" returned: 0 in 0.512s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:40 devstack sudo[87817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 1G
Apr 14 01:24:40 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:40 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd.26278484-2c1b-42f7-b4a7-35b3f7663616" returned: 0 in 0.510s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-26278484-2c1b-42f7-b4a7-35b3f7663616" released by "_delete_snapshot" :: held 1.971s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-c54af069-56a7-4085-b5ac-137a4415d4fd" released by "delete_snapshot" :: held 1.980s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Created reservations ['7ce50bfc-a430-4173-8341-4b7663781e9f', 'd3b79406-6e7d-4c29-814f-7f7b1b9c5c8c', '8c40319a-ec09-4f6d-a09d-cc10764461d8', '759ec144-6691-46de-ab82-65b7d97ff7c3'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:40 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Delete snapshot completed successfully.
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2acdaf17-166f-46d9-b1ed-09b56a96a411 tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-26278484-2c1b-42f7-b4a7-35b3f7663616-delete_snapshot" released by "delete_snapshot" :: held 2.085s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-c54af069-56a7-4085-b5ac-137a4415d4fd-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-c54af069-56a7-4085-b5ac-137a4415d4fd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Acquiring lock "cinder-b69f914d-b87c-4356-91ae-9a34b52b35c4-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-quobyte-c54af069-56a7-4085-b5ac-137a4415d4fd" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Lock "cinder-b69f914d-b87c-4356-91ae-9a34b52b35c4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-c54af069-56a7-4085-b5ac-137a4415d4fd" acquired by "delete_volume" :: waited 0.017s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8bf208-a710-4c6b-9302-44c8c9155a37]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Acquiring lock "cinder-quobyte-b69f914d-b87c-4356-91ae-9a34b52b35c4" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Lock "cinder-quobyte-b69f914d-b87c-4356-91ae-9a34b52b35c4" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d60ed1-d4aa-488c-9684-5cd34f748449]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b69f914d-b87c-4356-91ae-9a34b52b35c4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:40 devstack sudo[87819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd
Apr 14 01:24:40 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:40 devstack sudo[87823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b69f914d-b87c-4356-91ae-9a34b52b35c4
Apr 14 01:24:40 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:40 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 1G" returned: 0 in 0.516s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:40 devstack sudo[87826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2
Apr 14 01:24:40 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:41 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd" returned: 0 in 0.492s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:41 devstack sudo[87834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd
Apr 14 01:24:41 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:41 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b69f914d-b87c-4356-91ae-9a34b52b35c4" returned: 0 in 0.492s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b69f914d-b87c-4356-91ae-9a34b52b35c4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:41 devstack sudo[87839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b69f914d-b87c-4356-91ae-9a34b52b35c4
Apr 14 01:24:41 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:41 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2" returned: 0 in 0.445s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:41 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 is being set with open permissions: ugo+rw
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:41 devstack sudo[87841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2
Apr 14 01:24:41 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:41 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c54af069-56a7-4085-b5ac-137a4415d4fd" returned: 0 in 0.413s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-c54af069-56a7-4085-b5ac-137a4415d4fd" released by "delete_volume" :: held 0.953s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Created reservations ['e7dfdec5-76fb-4b8a-b573-9ea4db3ffb94', '95f1770b-8816-4989-a494-ffa280b07dc3', '909a25af-8097-4ae8-b1cb-aa99685fc5bc', '9e1a8dca-71c6-4220-8475-48dd7a1fe504'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:41 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b69f914d-b87c-4356-91ae-9a34b52b35c4" returned: 0 in 0.433s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:41 devstack sudo[87846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:41 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Lock "cinder-quobyte-b69f914d-b87c-4356-91ae-9a34b52b35c4" released by "delete_volume" :: held 1.009s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:41 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2" returned: 0 in 0.446s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Created reservations ['deaa4bcb-4399-4872-b050-cfd235b8dfc4', '15291803-c0a0-4534-a2c1-bf035360cd35', '8cf68871-b3af-40cc-8f58-7dc5487079fb', 'aef2a389-7b44-4e14-a98b-62299218574d'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:41 devstack sudo[87848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.info
Apr 14 01:24:41 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:41 devstack sudo[87850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:41 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Flow 'volume_create_manager' (9c54ea40-0aa9-4f7f-a75d-5a0eb3f45191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5364c3-2c82-41c2-a52b-5dcb29da5791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5364c3-2c82-41c2-a52b-5dcb29da5791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-429186693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966d62c8-a149-43aa-9f04-ff036dba8d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21b1d0ca6fd44358d2aa6676d7ef6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:42Z,use_quota=True,user_id='c8fb6f7a18c248f5bc7b815398d4af5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8562a735-2d14-446b-9f86-25e8287b0b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8562a735-2d14-446b-9f86-25e8287b0b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a772e0a6-ccb1-4f3b-95c2-deb157baa1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a772e0a6-ccb1-4f3b-95c2-deb157baa1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '966d62c8-a149-43aa-9f04-ff036dba8d71', 'volume_name': 'volume-966d62c8-a149-43aa-9f04-ff036dba8d71', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882e8692-e2f9-4567-bd88-a7f006980764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882e8692-e2f9-4567-bd88-a7f006980764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd53ca5-716f-4551-80ae-d0e1f4c655fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:42 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Volume 966d62c8-a149-43aa-9f04-ff036dba8d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-966d62c8-a149-43aa-9f04-ff036dba8d71', 'volume_size': 1}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:42 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.info" returned: 0 in 0.418s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:42 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.info is being set with open permissions: ugo+rw
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:42 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.498s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:42 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Deleted volume successfully.
Apr 14 01:24:42 devstack sudo[87854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.info
Apr 14 01:24:42 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-055357ed-1b5b-4575-97f9-aed3bb393f15 tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-c54af069-56a7-4085-b5ac-137a4415d4fd-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:42 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.459s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:42 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Deleted volume successfully.
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8163a322-3e6a-4f79-8bba-d73a548f5cf0 tempest-VolumesMetadataTest-1305041635 None] Lock "cinder-b69f914d-b87c-4356-91ae-9a34b52b35c4-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:42 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.info" returned: 0 in 0.443s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.852s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.527s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-429186693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966d62c8-a149-43aa-9f04-ff036dba8d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21b1d0ca6fd44358d2aa6676d7ef6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:42Z,use_quota=True,user_id='c8fb6f7a18c248f5bc7b815398d4af5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Creating volume 966d62c8-a149-43aa-9f04-ff036dba8d71 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:24:42 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:24:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:42 devstack sudo[87858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71 1073741824
Apr 14 01:24:42 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:42 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-58e3a08b-9778-48ee-acf1-e2b0bd65cbe2 tempest-VolumesSnapshotListTestJSON-854523724 None] Create snapshot completed successfully
Apr 14 01:24:43 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71 1073741824" returned: 0 in 0.527s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:UPDATE=191,cinder:SELECT=168,cinder:INSERT=68,cinder:DELETE=15 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:43 devstack sudo[87863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71
Apr 14 01:24:43 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:43 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71" returned: 0 in 0.503s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd53ca5-716f-4551-80ae-d0e1f4c655fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-966d62c8-a149-43aa-9f04-ff036dba8d71', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49902aac-a58f-4dd7-bade-a99df823b327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:43 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Volume volume-966d62c8-a149-43aa-9f04-ff036dba8d71 (966d62c8-a149-43aa-9f04-ff036dba8d71): created successfully
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49902aac-a58f-4dd7-bade-a99df823b327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Flow 'volume_create_manager' (9c54ea40-0aa9-4f7f-a75d-5a0eb3f45191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:43 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-dbc2024c-3902-4999-9480-e03bac199bf3 tempest-VolumeDependencyTests-2026088499 None] Created volume successfully.
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] Creating offline snapshot 3457451d-fc4d-4b78-b369-e24c47d1f7c1 of volume 1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb842b71-33a0-43b5-8d02-7656b09cba92]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:43 devstack sudo[87866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2
Apr 14 01:24:43 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:44 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2" returned: 0 in 0.531s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:44 devstack sudo[87871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 1G
Apr 14 01:24:44 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:UPDATE=226,cinder:DELETE=20,cinder:SELECT=177,cinder:INSERT=53 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Flow 'volume_create_manager' (9ddf36cc-e569-45c0-85ab-058908e7b5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5506568-a05c-4f63-bb24-14d088fbfc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5506568-a05c-4f63-bb24-14d088fbfc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-43802538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd7b9e8-30f7-4c17-a5b3-c21868db8234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21b1d0ca6fd44358d2aa6676d7ef6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=966d62c8-a149-43aa-9f04-ff036dba8d71,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:44Z,use_quota=True,user_id='c8fb6f7a18c248f5bc7b815398d4af5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383fc13e-93ad-4a5e-bbf1-af2ce77c14ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383fc13e-93ad-4a5e-bbf1-af2ce77c14ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fc8f09-005b-4662-9908-a37ba9a9674d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fc8f09-005b-4662-9908-a37ba9a9674d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fdd7b9e8-30f7-4c17-a5b3-c21868db8234', 'volume_name': 'volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234', 'volume_size': 1, 'source_volid': '966d62c8-a149-43aa-9f04-ff036dba8d71', 'source_volstatus': 'available'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5b0fd8-cde7-4a67-a216-6ac40d9ed876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5b0fd8-cde7-4a67-a216-6ac40d9ed876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e0d82a-de11-4b89-8ae0-b570d0688fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:44 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Volume fdd7b9e8-30f7-4c17-a5b3-c21868db8234: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234', 'volume_size': 1, 'source_volid': '966d62c8-a149-43aa-9f04-ff036dba8d71', 'source_volstatus': 'available'}
Apr 14 01:24:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:45 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 1G" returned: 0 in 0.622s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:45 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1
Apr 14 01:24:45 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Flow 'volume_create_manager' (af04ba71-255c-4e31-9f83-074badedd7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8516ea22-2d42-455e-b1be-b2636dea5eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8516ea22-2d42-455e-b1be-b2636dea5eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1800682646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd891b9-2450-4771-b7e5-874e827d6975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692faa7ee94b4aaab845a5472787305b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:45Z,use_quota=True,user_id='5d217180549049cdb624562220412e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fc1dec-dfa3-4102-b307-fa73235c4525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fc1dec-dfa3-4102-b307-fa73235c4525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d28bb6-bc29-434c-8bba-16d540ba5c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d28bb6-bc29-434c-8bba-16d540ba5c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbd891b9-2450-4771-b7e5-874e827d6975', 'volume_name': 'volume-bbd891b9-2450-4771-b7e5-874e827d6975', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79622e95-6f2e-4791-8ba2-cc9a82c819f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79622e95-6f2e-4791-8ba2-cc9a82c819f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4d87af-4385-4402-b403-3631988fe012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:45 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Volume bbd891b9-2450-4771-b7e5-874e827d6975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbd891b9-2450-4771-b7e5-874e827d6975', 'volume_size': 1}
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:45 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1" returned: 0 in 0.509s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:45 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 is being set with open permissions: ugo+rw
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:45 devstack sudo[87881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1
Apr 14 01:24:45 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:45 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1" returned: 0 in 0.415s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.363s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:45 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Cloning volume 966d62c8-a149-43aa-9f04-ff036dba8d71 to volume fdd7b9e8-30f7-4c17-a5b3-c21868db8234
Apr 14 01:24:45 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c4c517fb-d790-4fa2-ba37-d02c54401966 tempest-VolumesSnapshotListTestJSON-854523724 None] Create snapshot completed successfully
Apr 14 01:24:45 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Creating offline snapshot 41a30317-96ed-45a2-bf04-cddfb7a6023f of volume 966d62c8-a149-43aa-9f04-ff036dba8d71 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:24:46 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[19423da2-ce2c-4699-9e30-90ea3549cc5c]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:46 devstack sudo[87884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71
Apr 14 01:24:46 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:46 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71" returned: 0 in 0.487s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:46 devstack sudo[87889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f 1G
Apr 14 01:24:46 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:46 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f 1G" returned: 0 in 0.501s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966d62c8-a149-43aa-9f04-ff036dba8d71 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:47 devstack sudo[87894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966d62c8-a149-43aa-9f04-ff036dba8d71 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f
Apr 14 01:24:47 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:47 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966d62c8-a149-43aa-9f04-ff036dba8d71 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f" returned: 0 in 0.434s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:47 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f is being set with open permissions: ugo+rw
Apr 14 01:24:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:47 devstack sudo[87900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f
Apr 14 01:24:47 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:47 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f" returned: 0 in 0.399s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:47 devstack sudo[87903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.info
Apr 14 01:24:47 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:48 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.info" returned: 0 in 0.415s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:48 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.info is being set with open permissions: ugo+rw
Apr 14 01:24:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:48 devstack sudo[87906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.info
Apr 14 01:24:48 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:48 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.info" returned: 0 in 0.419s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-quobyte-fdd7b9e8-30f7-4c17-a5b3-c21868db8234" by "_copy_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-fdd7b9e8-30f7-4c17-a5b3-c21868db8234" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] snapshot: 41a30317-96ed-45a2-bf04-cddfb7a6023f, volume: fdd7b9e8-30f7-4c17-a5b3-c21868db8234,  {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 14 01:24:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:48 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aad2c2-453a-4829-a0e6-b55389ae08c5]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:48 devstack sudo[87909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f
Apr 14 01:24:48 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:49 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f" returned: 0 in 0.473s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-966d62c8-a149-43aa-9f04-ff036dba8d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:24:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71 {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 14 01:24:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Creating direct copy from snapshot {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 14 01:24:49 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be2f1a6-40fe-4e09-9488-a50ffb63d31b]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:49 devstack sudo[87914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71
Apr 14 01:24:49 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:49 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71" returned: 0 in 0.465s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:49 devstack cinder-volume[81812]: DEBUG cinder.utils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Path /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234 not found in is_blk_device check {{(pid=81812) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 14 01:24:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:49 devstack sudo[87919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234
Apr 14 01:24:49 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:51 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234" returned: 0 in 1.985s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:51 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c85f59-5087-49b7-a6d8-836c91ff4814]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:51 devstack sudo[87931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71
Apr 14 01:24:51 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:52 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71" returned: 0 in 0.605s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:52 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71, size 1024.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234 {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:24:52 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Converted 1024.00 MB image at 515.44 MB/s
Apr 14 01:24:52 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234 is being set with open permissions: ugo+rw
Apr 14 01:24:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:52 devstack sudo[87936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234
Apr 14 01:24:52 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:52 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234" returned: 0 in 0.404s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:52 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-fdd7b9e8-30f7-4c17-a5b3-c21868db8234" released by "_copy_volume_from_snapshot" :: held 3.976s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:52 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-quobyte-41a30317-96ed-45a2-bf04-cddfb7a6023f" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:52 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-41a30317-96ed-45a2-bf04-cddfb7a6023f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Deleting offline snapshot 41a30317-96ed-45a2-bf04-cddfb7a6023f of volume 966d62c8-a149-43aa-9f04-ff036dba8d71 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:24:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] snapshot_file for this snap is: volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:24:52 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9b8c75-60c9-45e7-8c19-1b0ef5f3e641]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:52 devstack sudo[87939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f
Apr 14 01:24:52 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:53 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f" returned: 0 in 0.478s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-966d62c8-a149-43aa-9f04-ff036dba8d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:24:53 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32a7dfe-e984-4f30-95ef-7476dff91547]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:53 devstack sudo[87944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71
Apr 14 01:24:53 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:53 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71" returned: 0 in 0.471s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:53 devstack sudo[87949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f
Apr 14 01:24:53 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:54 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f" returned: 0 in 0.452s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:54 devstack sudo[87954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f
Apr 14 01:24:54 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:54 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71.41a30317-96ed-45a2-bf04-cddfb7a6023f" returned: 0 in 0.406s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-41a30317-96ed-45a2-bf04-cddfb7a6023f" released by "_delete_snapshot" :: held 1.867s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.617s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.082s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1800682646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd891b9-2450-4771-b7e5-874e827d6975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692faa7ee94b4aaab845a5472787305b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:45Z,use_quota=True,user_id='5d217180549049cdb624562220412e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Creating volume bbd891b9-2450-4771-b7e5-874e827d6975 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:24:54 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bbd891b9-2450-4771-b7e5-874e827d6975 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e0d82a-de11-4b89-8ae0-b570d0688fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234', 'volume_size': 1, 'source_volid': '966d62c8-a149-43aa-9f04-ff036dba8d71', 'source_volstatus': 'available'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482625d4-d129-4479-9b2d-939cf14c47b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:54 devstack sudo[87957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bbd891b9-2450-4771-b7e5-874e827d6975 1073741824
Apr 14 01:24:54 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:54 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Volume volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234 (fdd7b9e8-30f7-4c17-a5b3-c21868db8234): created successfully
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482625d4-d129-4479-9b2d-939cf14c47b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Flow 'volume_create_manager' (9ddf36cc-e569-45c0-85ab-058908e7b5ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:54 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-6ed234c4-07d7-45fb-90b5-e62a2f92fc0f tempest-VolumeDependencyTests-2026088499 None] Created volume successfully.
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-966d62c8-a149-43aa-9f04-ff036dba8d71-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-966d62c8-a149-43aa-9f04-ff036dba8d71-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-quobyte-966d62c8-a149-43aa-9f04-ff036dba8d71" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-966d62c8-a149-43aa-9f04-ff036dba8d71" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:55 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bbd891b9-2450-4771-b7e5-874e827d6975 1073741824" returned: 0 in 0.516s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27e6758-dd88-4e31-86c5-bcf1681ec9dd]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bbd891b9-2450-4771-b7e5-874e827d6975 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:55 devstack sudo[87963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bbd891b9-2450-4771-b7e5-874e827d6975
Apr 14 01:24:55 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:55 devstack sudo[87962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71
Apr 14 01:24:55 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:55 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bbd891b9-2450-4771-b7e5-874e827d6975" returned: 0 in 0.423s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.537s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] Creating offline snapshot a83eb7e8-01d7-42d3-9a54-3389455ccac7 of volume 1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:24:55 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71" returned: 0 in 0.478s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4d87af-4385-4402-b403-3631988fe012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd891b9-2450-4771-b7e5-874e827d6975', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f6c064-5421-4a72-a57a-97498b181bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a536cc-d544-4190-9739-5db4f2bacc62]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:55 devstack sudo[87970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71
Apr 14 01:24:55 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:55 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Volume volume-bbd891b9-2450-4771-b7e5-874e827d6975 (bbd891b9-2450-4771-b7e5-874e827d6975): created successfully
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f6c064-5421-4a72-a57a-97498b181bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:55 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Flow 'volume_create_manager' (af04ba71-255c-4e31-9f83-074badedd7b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:55 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-76435ae2-ba4a-4412-a0ae-5bda946bc489 tempest-VolumesTransfersV355Test-852217060 None] Created volume successfully.
Apr 14 01:24:55 devstack sudo[87971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1
Apr 14 01:24:55 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:56 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-966d62c8-a149-43aa-9f04-ff036dba8d71" returned: 0 in 0.428s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-966d62c8-a149-43aa-9f04-ff036dba8d71" released by "delete_volume" :: held 0.965s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Created reservations ['88fa94c3-c07c-4dd9-bb91-63440a56bc88', '8a39cfd0-24d2-4e4e-bdee-67c07bdefa3d', 'ed52f24e-38c8-4ef1-af4b-2031a5819e24', 'd5c4084e-6b76-4253-b6ef-2578dadfaadc'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:56 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1" returned: 0 in 0.550s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:56 devstack sudo[87978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:56 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-fdd7b9e8-30f7-4c17-a5b3-c21868db8234-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:56 devstack sudo[87979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7 1G
Apr 14 01:24:56 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-fdd7b9e8-30f7-4c17-a5b3-c21868db8234-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-quobyte-fdd7b9e8-30f7-4c17-a5b3-c21868db8234" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-fdd7b9e8-30f7-4c17-a5b3-c21868db8234" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ff2b33-3abf-49fd-969d-4cad8201e135]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:56 devstack sudo[87982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234
Apr 14 01:24:56 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:56 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3f5bb940-b2b4-4fa1-b164-f3206f425c83 tempest-VolumesTransfersV355Test-871940649 None] Transfer volume completed successfully.
Apr 14 01:24:56 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.522s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:56 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Deleted volume successfully.
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f3d63e7b-8180-4f0a-8678-f2b0123cc146 tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-966d62c8-a149-43aa-9f04-ff036dba8d71-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:56 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7 1G" returned: 0 in 0.630s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:56 devstack sudo[87991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7
Apr 14 01:24:56 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:56 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234" returned: 0 in 0.623s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:56 devstack sudo[87994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234
Apr 14 01:24:56 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Acquiring lock "cinder-bbd891b9-2450-4771-b7e5-874e827d6975-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Lock "cinder-bbd891b9-2450-4771-b7e5-874e827d6975-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Acquiring lock "cinder-quobyte-bbd891b9-2450-4771-b7e5-874e827d6975" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Lock "cinder-quobyte-bbd891b9-2450-4771-b7e5-874e827d6975" acquired by "delete_volume" :: waited 0.025s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca610b2b-a355-4bfd-bc3c-2a4a81612ce2]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bbd891b9-2450-4771-b7e5-874e827d6975 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:57 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7" returned: 0 in 0.536s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:57 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7 is being set with open permissions: ugo+rw
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:57 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fdd7b9e8-30f7-4c17-a5b3-c21868db8234" returned: 0 in 0.475s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-fdd7b9e8-30f7-4c17-a5b3-c21868db8234" released by "delete_volume" :: held 1.124s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:57 devstack sudo[88002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7
Apr 14 01:24:57 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Created reservations ['af2b4ea4-18ae-47ff-9ee7-a8ed329a8e71', 'b0d2b707-c76c-4bdc-a2f4-186745660793', 'edd4eacd-0c67-47f3-b1da-fc4e1c398344', 'a9509838-4f8c-4d98-ac7f-d2d526ea1143'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:57 devstack sudo[88000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bbd891b9-2450-4771-b7e5-874e827d6975
Apr 14 01:24:57 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:57 devstack sudo[88005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:57 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:57 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7" returned: 0 in 0.419s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.213s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:57 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5ef2effd-6b9f-440e-86fc-cada09faa03f tempest-VolumesSnapshotListTestJSON-854523724 None] Create snapshot completed successfully
Apr 14 01:24:57 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bbd891b9-2450-4771-b7e5-874e827d6975" returned: 0 in 0.505s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bbd891b9-2450-4771-b7e5-874e827d6975 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:57 devstack sudo[88012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bbd891b9-2450-4771-b7e5-874e827d6975
Apr 14 01:24:57 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:57 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.427s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:57 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Deleted volume successfully.
Apr 14 01:24:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a063e6a8-d692-40d9-8c90-47b35619627c tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-fdd7b9e8-30f7-4c17-a5b3-c21868db8234-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:58 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-bbd891b9-2450-4771-b7e5-874e827d6975" returned: 0 in 0.446s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Lock "cinder-quobyte-bbd891b9-2450-4771-b7e5-874e827d6975" released by "delete_volume" :: held 0.973s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Created reservations ['7885ed05-9fcd-4d3e-8d24-e075e8dcbc83', 'fdb13809-21fc-4dde-ae01-31a41c57d697', '047aef98-f3e0-498e-80f0-835c8318a34e', 'cdbd699e-185e-4ae4-881e-cb2b045a44cf'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:58 devstack sudo[88015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:58 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-9c2d2bda-5c93-4810-afcc-2112d0d355e5-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-9c2d2bda-5c93-4810-afcc-2112d0d355e5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "cinder-quobyte-9c2d2bda-5c93-4810-afcc-2112d0d355e5" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-9c2d2bda-5c93-4810-afcc-2112d0d355e5" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fca82b3-04a0-44a9-8060-2946102f2c94]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:58 devstack sudo[88017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5
Apr 14 01:24:58 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Flow 'volume_create_manager' (8a2b841f-e13d-4c3d-bb5f-51bfca3cbf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b2b625-340f-48c0-90fe-1b6fbd94db0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b2b625-340f-48c0-90fe-1b6fbd94db0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-886580837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cbe902-36b2-4407-81fb-72c300165699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692faa7ee94b4aaab845a5472787305b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:59Z,use_quota=True,user_id='5d217180549049cdb624562220412e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030293f2-f47e-4b63-8ea9-cf49ae63c759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030293f2-f47e-4b63-8ea9-cf49ae63c759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9a6f01-7510-4328-9f3c-a8d0f064bfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9a6f01-7510-4328-9f3c-a8d0f064bfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41cbe902-36b2-4407-81fb-72c300165699', 'volume_name': 'volume-41cbe902-36b2-4407-81fb-72c300165699', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b20982-36e6-4da3-8ef3-0eb4498bd0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b20982-36e6-4da3-8ef3-0eb4498bd0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3915a29-e614-44e1-9236-953733d120c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:58 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Volume 41cbe902-36b2-4407-81fb-72c300165699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41cbe902-36b2-4407-81fb-72c300165699', 'volume_size': 1}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-886580837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cbe902-36b2-4407-81fb-72c300165699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692faa7ee94b4aaab845a5472787305b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:24:59Z,use_quota=True,user_id='5d217180549049cdb624562220412e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Creating volume 41cbe902-36b2-4407-81fb-72c300165699 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:24:58 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-41cbe902-36b2-4407-81fb-72c300165699 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:58 devstack sudo[88019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-41cbe902-36b2-4407-81fb-72c300165699 1073741824
Apr 14 01:24:58 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:58 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.605s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:58 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:24:58 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Deleted volume successfully.
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fea76580-f745-460d-bd8e-680515253984 tempest-VolumesTransfersV355Test-836679833 None] Lock "cinder-bbd891b9-2450-4771-b7e5-874e827d6975-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:59 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5" returned: 0 in 0.612s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:59 devstack sudo[88025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5
Apr 14 01:24:59 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:59 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-41cbe902-36b2-4407-81fb-72c300165699 1073741824" returned: 0 in 0.518s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-41cbe902-36b2-4407-81fb-72c300165699 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:59 devstack sudo[88030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-41cbe902-36b2-4407-81fb-72c300165699
Apr 14 01:24:59 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "cinder-a83eb7e8-01d7-42d3-9a54-3389455ccac7-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-a83eb7e8-01d7-42d3-9a54-3389455ccac7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "cinder-quobyte-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-quobyte-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "cinder-quobyte-a83eb7e8-01d7-42d3-9a54-3389455ccac7" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-quobyte-a83eb7e8-01d7-42d3-9a54-3389455ccac7" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Deleting offline snapshot a83eb7e8-01d7-42d3-9a54-3389455ccac7 of volume 1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] snapshot_file for this snap is: volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd5d9b6-9488-4117-ae7c-3330fca28a36]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:59 devstack sudo[88032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7
Apr 14 01:24:59 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:59 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-9c2d2bda-5c93-4810-afcc-2112d0d355e5" returned: 0 in 0.443s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-quobyte-9c2d2bda-5c93-4810-afcc-2112d0d355e5" released by "delete_volume" :: held 1.091s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Created reservations ['2915eb8b-f456-41a4-b0a7-d573487d3898', '65849b60-f8db-4f43-9a0d-9ad13ce2127c', 'e9a82225-8923-4399-ada0-dacff171ab4b', 'f4e3fc24-c6c6-47f2-8a2f-32233e6831dc'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:24:59 devstack sudo[88035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:24:59 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:24:59 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-41cbe902-36b2-4407-81fb-72c300165699" returned: 0 in 0.466s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3915a29-e614-44e1-9236-953733d120c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41cbe902-36b2-4407-81fb-72c300165699', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e98d398-3592-427a-a16d-dd437ad5dc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:24:59 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Volume volume-41cbe902-36b2-4407-81fb-72c300165699 (41cbe902-36b2-4407-81fb-72c300165699): created successfully
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e98d398-3592-427a-a16d-dd437ad5dc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:24:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Flow 'volume_create_manager' (8a2b841f-e13d-4c3d-bb5f-51bfca3cbf3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:24:59 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b592da76-73fb-4e3d-88ae-bd276243481d tempest-VolumesTransfersV355Test-852217060 None] Created volume successfully.
Apr 14 01:25:00 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7" returned: 0 in 0.491s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:25:00 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e7a48c-88c0-4d4c-8ec4-180e205e59bb]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:00 devstack sudo[88041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1
Apr 14 01:25:00 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:00 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.425s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:00 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:25:00 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Deleted volume successfully.
Apr 14 01:25:00 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b3c3aa7b-99f6-4157-9b1e-a8f1a506aa0a tempest-VolumeDependencyTests-2026088499 None] Lock "cinder-9c2d2bda-5c93-4810-afcc-2112d0d355e5-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:00 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1" returned: 0 in 0.505s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:25:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:00 devstack sudo[88190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7
Apr 14 01:25:00 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Acquiring lock "cinder-41cbe902-36b2-4407-81fb-72c300165699-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Lock "cinder-41cbe902-36b2-4407-81fb-72c300165699-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Acquiring lock "cinder-quobyte-41cbe902-36b2-4407-81fb-72c300165699" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Lock "cinder-quobyte-41cbe902-36b2-4407-81fb-72c300165699" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:01 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7" returned: 0 in 0.604s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f909ab-c611-40f0-bdeb-a595715d7228]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-41cbe902-36b2-4407-81fb-72c300165699 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:01 devstack sudo[88195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7
Apr 14 01:25:01 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:01 devstack sudo[88196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-41cbe902-36b2-4407-81fb-72c300165699
Apr 14 01:25:01 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:01 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.a83eb7e8-01d7-42d3-9a54-3389455ccac7" returned: 0 in 0.524s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-quobyte-a83eb7e8-01d7-42d3-9a54-3389455ccac7" released by "_delete_snapshot" :: held 2.172s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-quobyte-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" released by "delete_snapshot" :: held 2.184s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Created reservations ['68b86f95-e82e-462e-bf51-c07967187d4b', 'ae794b9a-d7c9-467e-baaa-39986b2cbd8e', '236ea464-9ab4-471d-9266-eb849e6331ba', '1ce3147d-72dd-48d7-8605-4e39f16583fc'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:01 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Delete snapshot completed successfully.
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4963c155-1b39-4a3b-a2d9-071def6a91d9 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-a83eb7e8-01d7-42d3-9a54-3389455ccac7-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:01 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-41cbe902-36b2-4407-81fb-72c300165699" returned: 0 in 0.612s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-41cbe902-36b2-4407-81fb-72c300165699 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:01 devstack sudo[88203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-41cbe902-36b2-4407-81fb-72c300165699
Apr 14 01:25:01 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:02 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-41cbe902-36b2-4407-81fb-72c300165699" returned: 0 in 0.407s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Lock "cinder-quobyte-41cbe902-36b2-4407-81fb-72c300165699" released by "delete_volume" :: held 1.051s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Created reservations ['8a2c0092-4a40-4996-8254-1200cf12a701', 'be551356-02d0-4781-8f3a-78e4b673bdea', '8f1635d0-6115-4783-b5ab-0835672fc4c3', 'a03aab2c-377f-4770-b898-9c4de53d5b8f'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:02 devstack sudo[88206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:25:02 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "cinder-3457451d-fc4d-4b78-b369-e24c47d1f7c1-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:02 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.426s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-3457451d-fc4d-4b78-b369-e24c47d1f7c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "cinder-quobyte-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:02 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Deleted volume successfully.
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-quobyte-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "cinder-quobyte-3457451d-fc4d-4b78-b369-e24c47d1f7c1" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c48477e4-1a69-491c-ac6b-7f76f2b1e5e3 tempest-VolumesTransfersV355Test-836679833 None] Lock "cinder-41cbe902-36b2-4407-81fb-72c300165699-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-quobyte-3457451d-fc4d-4b78-b369-e24c47d1f7c1" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Deleting offline snapshot 3457451d-fc4d-4b78-b369-e24c47d1f7c1 of volume 1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] snapshot_file for this snap is: volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e46afee-f2b4-4efa-89ac-851562eb4d47]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:02 devstack sudo[88209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1
Apr 14 01:25:02 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:03 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1" returned: 0 in 0.456s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:25:03 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a137af-902f-4b93-8189-b1fb018f1790]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:03 devstack sudo[88214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2
Apr 14 01:25:03 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:03 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2" returned: 0 in 0.534s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:25:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:03 devstack sudo[88219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1
Apr 14 01:25:03 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:03 devstack cinder-volume[81812]: DEBUG oslo_service.periodic_task [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81812) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:25:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:03 devstack sudo[88221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:25:03 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:04 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1" returned: 0 in 0.597s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:04 devstack sudo[88227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1
Apr 14 01:25:04 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:04 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.459s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:04 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:25:04 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.3457451d-fc4d-4b78-b369-e24c47d1f7c1" returned: 0 in 0.469s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-quobyte-3457451d-fc4d-4b78-b369-e24c47d1f7c1" released by "_delete_snapshot" :: held 2.104s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-quobyte-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" released by "delete_snapshot" :: held 2.121s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:04 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Created reservations ['488b98aa-c56d-49ad-87eb-856869993a57', '5acf05dd-3009-4d7a-b838-e54ca63adbe6', 'deb6b2d6-1b61-4665-a61e-5c9e09288d14', 'ceb3b117-26bb-4310-9884-a5d71b6d3351'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:04 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Delete snapshot completed successfully.
Apr 14 01:25:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-800206d2-ebcb-4a9a-bdf1-3d09421ee733 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-3457451d-fc4d-4b78-b369-e24c47d1f7c1-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "cinder-ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "cinder-quobyte-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-quobyte-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "cinder-quobyte-ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-quobyte-ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Deleting offline snapshot ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 of volume 1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:25:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] snapshot_file for this snap is: volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:25:05 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9a3936-34ad-4dfc-b0c2-d27707bc3b6e]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:05 devstack sudo[88236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2
Apr 14 01:25:05 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:06 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2" returned: 0 in 0.513s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:25:06 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c902c3bc-8a73-4def-9f55-3057c1da7bc2]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:06 devstack sudo[88241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc
Apr 14 01:25:06 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:06 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" returned: 0 in 0.501s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:06 devstack sudo[88246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2
Apr 14 01:25:06 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Flow 'volume_create_manager' (32be820f-c1e9-4798-af8c-99093af77fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:07 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3473dc1-ba45-4c92-b024-cb1a7d89a5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3473dc1-ba45-4c92-b024-cb1a7d89a5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1908391983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b593e11d-828e-4d72-b2b6-dfc34af3dbbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461bca08b0f74c0f993b058fd7a74b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:07Z,use_quota=True,user_id='f3fc0c6cbbac4e74b01f9d085e93f8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dad4078-c976-47e3-b4cf-662b809a30df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dad4078-c976-47e3-b4cf-662b809a30df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966766b8-f83e-47f0-a020-a2657c764629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966766b8-f83e-47f0-a020-a2657c764629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b593e11d-828e-4d72-b2b6-dfc34af3dbbe', 'volume_name': 'volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b5151e5-ef7b-4bb5-9c16-319ac8f2d866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b5151e5-ef7b-4bb5-9c16-319ac8f2d866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8977da99-cd62-47d2-b533-eff5887049fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:07 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Volume b593e11d-828e-4d72-b2b6-dfc34af3dbbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe', 'volume_size': 1}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1908391983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b593e11d-828e-4d72-b2b6-dfc34af3dbbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461bca08b0f74c0f993b058fd7a74b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:07Z,use_quota=True,user_id='f3fc0c6cbbac4e74b01f9d085e93f8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Creating volume b593e11d-828e-4d72-b2b6-dfc34af3dbbe {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:25:07 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2" returned: 0 in 0.533s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:07 devstack sudo[88252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe 1073741824
Apr 14 01:25:07 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:07 devstack sudo[88253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2
Apr 14 01:25:07 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:07 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc.ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2" returned: 0 in 0.418s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-quobyte-ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2" released by "_delete_snapshot" :: held 2.021s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-quobyte-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" released by "delete_snapshot" :: held 2.033s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:07 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe 1073741824" returned: 0 in 0.482s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Created reservations ['8079a233-2d60-4809-a2d6-37d4f4c58eb8', 'bc5e3057-0bb0-4947-abd3-15857d87f61e', '52de3b13-6c90-46ef-a2d6-9f2a47d62ed0', '123d816c-3b8f-44f3-9d2c-84b8834e77a9'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:07 devstack sudo[88260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe
Apr 14 01:25:07 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:07 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Delete snapshot completed successfully.
Apr 14 01:25:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-31c46f51-3cd0-4c3a-adf6-edab66f8b875 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-ee415ee4-5aac-4b4e-8c2d-03f429aaf7e2-delete_snapshot" released by "delete_snapshot" :: held 2.137s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:08 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe" returned: 0 in 0.426s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:25:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:08 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8977da99-cd62-47d2-b533-eff5887049fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:08 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708e52c5-9c07-4336-bd9c-9132edf79067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:08 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Volume volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe (b593e11d-828e-4d72-b2b6-dfc34af3dbbe): created successfully
Apr 14 01:25:08 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708e52c5-9c07-4336-bd9c-9132edf79067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:08 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Flow 'volume_create_manager' (32be820f-c1e9-4798-af8c-99093af77fdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:08 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-64238dbf-26d1-40f4-92cf-3648f09bb59b tempest-VolumesTransfersV357Test-768396305 None] Created volume successfully.
Apr 14 01:25:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "cinder-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "cinder-quobyte-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-quobyte-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" acquired by "delete_volume" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:09 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0c10ca-6336-46be-8a5a-97157251c09d]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:09 devstack sudo[88263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc
Apr 14 01:25:09 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:09 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" returned: 0 in 0.495s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:09 devstack sudo[88269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc
Apr 14 01:25:09 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:09 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2d1c0dc6-84f1-4151-a4ab-227e676768af tempest-VolumesTransfersV357Test-519472967 None] Transfer volume completed successfully.
Apr 14 01:25:10 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" returned: 0 in 0.426s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-quobyte-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc" released by "delete_volume" :: held 0.955s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Created reservations ['60c4f061-5b46-425e-bf9b-9488f49308c5', '4f2862c5-0760-40ef-95a3-da02035c3bfa', '827c1c2d-e81f-46d1-9557-296ad4896340', '05ab8113-2bde-4ce7-81f5-d98dcdcd7083'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:10 devstack sudo[88272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:25:10 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:10 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.501s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:25:10 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Deleted volume successfully.
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-770c7856-1597-42ac-aa28-6ebfaec9d700 tempest-VolumesSnapshotListTestJSON-854523724 None] Lock "cinder-1a1eca5a-ceda-48b5-b2ac-1c4a1d9fdccc-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Acquiring lock "cinder-b593e11d-828e-4d72-b2b6-dfc34af3dbbe-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Lock "cinder-b593e11d-828e-4d72-b2b6-dfc34af3dbbe-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Acquiring lock "cinder-quobyte-b593e11d-828e-4d72-b2b6-dfc34af3dbbe" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Lock "cinder-quobyte-b593e11d-828e-4d72-b2b6-dfc34af3dbbe" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ea03df-505e-43fd-9bd2-4a10ceebc566]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:10 devstack sudo[88275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe
Apr 14 01:25:10 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:11 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe" returned: 0 in 0.491s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:11 devstack sudo[88280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe
Apr 14 01:25:11 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:11 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b593e11d-828e-4d72-b2b6-dfc34af3dbbe" returned: 0 in 0.455s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Lock "cinder-quobyte-b593e11d-828e-4d72-b2b6-dfc34af3dbbe" released by "delete_volume" :: held 0.970s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Created reservations ['4f100c2f-03e0-4944-8741-7b1fed783c92', '2ef06b66-76e1-4f6f-a716-cd333154a380', '10ce8314-d2db-442b-a972-7ab54d8b62f2', 'e7873218-174e-45c0-b104-5e387b968a27'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:11 devstack sudo[88283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:25:11 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Flow 'volume_create_manager' (04508506-9f5f-4bc0-9493-cad85200c7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d473115a-b47f-4eff-868e-5941a7986fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d473115a-b47f-4eff-868e-5941a7986fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-339617649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736ace49-d1e8-441d-80c6-6e4bb5558350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85931d5b27242189e4595e7045abf42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:12Z,use_quota=True,user_id='a2721b607d2b4acfb685b5aa5f228c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cde495b-7b3e-4864-bf9f-12595686f47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cde495b-7b3e-4864-bf9f-12595686f47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4f9f50-a756-473d-b5cf-2ede16a9e762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4f9f50-a756-473d-b5cf-2ede16a9e762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '736ace49-d1e8-441d-80c6-6e4bb5558350', 'volume_name': 'volume-736ace49-d1e8-441d-80c6-6e4bb5558350', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b64340-5d46-408d-ada7-6645f9597418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b64340-5d46-408d-ada7-6645f9597418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c459808-b70d-43db-bf65-0c7401cbb558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:11 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume 736ace49-d1e8-441d-80c6-6e4bb5558350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-736ace49-d1e8-441d-80c6-6e4bb5558350', 'volume_size': 1}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-339617649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736ace49-d1e8-441d-80c6-6e4bb5558350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85931d5b27242189e4595e7045abf42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:12Z,use_quota=True,user_id='a2721b607d2b4acfb685b5aa5f228c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Creating volume 736ace49-d1e8-441d-80c6-6e4bb5558350 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:25:11 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:25:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-736ace49-d1e8-441d-80c6-6e4bb5558350 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:11 devstack sudo[88285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-736ace49-d1e8-441d-80c6-6e4bb5558350 1073741824
Apr 14 01:25:11 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Flow 'volume_create_manager' (16aa805a-2593-4c79-aad5-20ec6565c711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0a0194-1e4d-43c6-baf2-cfeea31fc413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0a0194-1e4d-43c6-baf2-cfeea31fc413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1033585769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c0ed9b-845b-44d9-ae6f-419b77e4363f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461bca08b0f74c0f993b058fd7a74b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:12Z,use_quota=True,user_id='f3fc0c6cbbac4e74b01f9d085e93f8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf8b2e1-e30c-4816-a809-664855498bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf8b2e1-e30c-4816-a809-664855498bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8446b5ec-a86d-43ae-9904-bdb54140a7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8446b5ec-a86d-43ae-9904-bdb54140a7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c0ed9b-845b-44d9-ae6f-419b77e4363f', 'volume_name': 'volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e8bf56-8963-4440-a0db-b88e653510d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e8bf56-8963-4440-a0db-b88e653510d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e8318a-931e-4a91-ab55-86dc962203a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:12 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Volume 48c0ed9b-845b-44d9-ae6f-419b77e4363f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f', 'volume_size': 1}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:12 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.494s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:25:12 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Deleted volume successfully.
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-00afb26f-5a05-4983-8db9-52ddce83138f tempest-VolumesTransfersV357Test-1195554777 None] Lock "cinder-b593e11d-828e-4d72-b2b6-dfc34af3dbbe-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:12 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-736ace49-d1e8-441d-80c6-6e4bb5558350 1073741824" returned: 0 in 0.505s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-736ace49-d1e8-441d-80c6-6e4bb5558350 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:12 devstack sudo[88291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-736ace49-d1e8-441d-80c6-6e4bb5558350
Apr 14 01:25:12 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:12 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-736ace49-d1e8-441d-80c6-6e4bb5558350" returned: 0 in 0.401s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1033585769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c0ed9b-845b-44d9-ae6f-419b77e4363f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461bca08b0f74c0f993b058fd7a74b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:12Z,use_quota=True,user_id='f3fc0c6cbbac4e74b01f9d085e93f8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Creating volume 48c0ed9b-845b-44d9-ae6f-419b77e4363f {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:25:12 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c459808-b70d-43db-bf65-0c7401cbb558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-736ace49-d1e8-441d-80c6-6e4bb5558350', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:12 devstack sudo[88294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f 1073741824
Apr 14 01:25:12 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (382e56de-6cf8-4b34-9904-1d13e3ca69b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:12 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume volume-736ace49-d1e8-441d-80c6-6e4bb5558350 (736ace49-d1e8-441d-80c6-6e4bb5558350): created successfully
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (382e56de-6cf8-4b34-9904-1d13e3ca69b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Flow 'volume_create_manager' (04508506-9f5f-4bc0-9493-cad85200c7c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:12 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-0e347b85-2b01-4ce7-9cab-acaef9f8467b tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Created volume successfully.
Apr 14 01:25:13 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f 1073741824" returned: 0 in 0.478s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:13 devstack sudo[88299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f
Apr 14 01:25:13 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:13 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f" returned: 0 in 0.405s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:25:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:13 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e8318a-931e-4a91-ab55-86dc962203a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:13 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae75372-438f-47ec-82de-2708aac7a92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:13 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Volume volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f (48c0ed9b-845b-44d9-ae6f-419b77e4363f): created successfully
Apr 14 01:25:13 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae75372-438f-47ec-82de-2708aac7a92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:13 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Flow 'volume_create_manager' (16aa805a-2593-4c79-aad5-20ec6565c711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:13 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f5a15aef-18ca-41df-b35d-6944833f6844 tempest-VolumesTransfersV357Test-768396305 None] Created volume successfully.
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Flow 'volume_create_manager' (fcb3f532-06ff-45c4-8d98-e6fba509ae81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da0225d-52a1-4f0c-8d0d-24ac1eaed111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da0225d-52a1-4f0c-8d0d-24ac1eaed111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-582443648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de4a233-7c3c-40bf-9488-18a4f7cb9efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85931d5b27242189e4595e7045abf42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:14Z,use_quota=True,user_id='a2721b607d2b4acfb685b5aa5f228c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92cff64d-5638-474d-a0e6-0e062d5f669c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92cff64d-5638-474d-a0e6-0e062d5f669c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8848267b-3440-48e7-84be-e0532e6ec41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8848267b-3440-48e7-84be-e0532e6ec41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de4a233-7c3c-40bf-9488-18a4f7cb9efe', 'volume_name': 'volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec368b5e-a7c9-4868-ab1e-917a302c325d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec368b5e-a7c9-4868-ab1e-917a302c325d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93db4415-b97f-46e8-a903-007e7f5b865e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume 7de4a233-7c3c-40bf-9488-18a4f7cb9efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe', 'volume_size': 1}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-582443648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de4a233-7c3c-40bf-9488-18a4f7cb9efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85931d5b27242189e4595e7045abf42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:14Z,use_quota=True,user_id='a2721b607d2b4acfb685b5aa5f228c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Creating volume 7de4a233-7c3c-40bf-9488-18a4f7cb9efe {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:25:14 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:14 devstack sudo[88422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe 1073741824
Apr 14 01:25:14 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Flow 'volume_create_manager' (f70dd185-4551-4409-b84f-8b50b269e5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36de6afb-4b0f-4afa-89c2-a65bb1a59dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36de6afb-4b0f-4afa-89c2-a65bb1a59dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-23569083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46107af-aad5-4181-84b7-b2f4cc327d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85931d5b27242189e4595e7045abf42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:14Z,use_quota=True,user_id='a2721b607d2b4acfb685b5aa5f228c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a16fec-e226-4137-b89d-0bd98cb1c75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a16fec-e226-4137-b89d-0bd98cb1c75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41645f30-4235-4b88-929f-8fe5e8e67f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41645f30-4235-4b88-929f-8fe5e8e67f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46107af-aad5-4181-84b7-b2f4cc327d78', 'volume_name': 'volume-a46107af-aad5-4181-84b7-b2f4cc327d78', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04047ca0-430c-4f97-b2c8-da71269a42e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04047ca0-430c-4f97-b2c8-da71269a42e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39a6c70-99bd-444b-b563-e00a39a25123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume a46107af-aad5-4181-84b7-b2f4cc327d78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46107af-aad5-4181-84b7-b2f4cc327d78', 'volume_size': 1}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Acquiring lock "cinder-48c0ed9b-845b-44d9-ae6f-419b77e4363f-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Lock "cinder-48c0ed9b-845b-44d9-ae6f-419b77e4363f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Acquiring lock "cinder-quobyte-48c0ed9b-845b-44d9-ae6f-419b77e4363f" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Lock "cinder-quobyte-48c0ed9b-845b-44d9-ae6f-419b77e4363f" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a61b4ae-4b3a-40ad-a352-d0c3550ea61b]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Flow 'volume_create_manager' (615568d9-318f-427b-941c-6da9797adffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379a6b08-318c-4e14-a338-69f80423af6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379a6b08-318c-4e14-a338-69f80423af6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1805385814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d91939b-d9ce-4dbc-9c6f-7c0345d626e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85931d5b27242189e4595e7045abf42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:15Z,use_quota=True,user_id='a2721b607d2b4acfb685b5aa5f228c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66001f64-f387-4e4b-ad61-697daa368568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66001f64-f387-4e4b-ad61-697daa368568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cd353e-7dee-46a3-8089-da67bb896e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cd353e-7dee-46a3-8089-da67bb896e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d91939b-d9ce-4dbc-9c6f-7c0345d626e4', 'volume_name': 'volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack sudo[88424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acadfb2-7859-4137-bfa3-a786c38faa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acadfb2-7859-4137-bfa3-a786c38faa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097df14b-954d-488b-9385-0e0a4484ee58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume 8d91939b-d9ce-4dbc-9c6f-7c0345d626e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4', 'volume_size': 1}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Flow 'volume_create_manager' (3d2350ae-631d-45f4-868a-22652df4138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957f9a72-5fd9-466c-892c-44d0816e25d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957f9a72-5fd9-466c-892c-44d0816e25d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-378756290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697c9f81-df31-45f5-a575-f617476e832a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85931d5b27242189e4595e7045abf42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:15Z,use_quota=True,user_id='a2721b607d2b4acfb685b5aa5f228c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b6b55c-c167-4177-948d-78b5b76d2385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b6b55c-c167-4177-948d-78b5b76d2385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf64c30-d841-42f8-b235-ea1ceff80f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf64c30-d841-42f8-b235-ea1ceff80f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '697c9f81-df31-45f5-a575-f617476e832a', 'volume_name': 'volume-697c9f81-df31-45f5-a575-f617476e832a', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b922df5a-cc93-4b8d-a52d-416b033bdfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b922df5a-cc93-4b8d-a52d-416b033bdfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5f8e9b-6c31-4044-95ef-c303d510df2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:14 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume 697c9f81-df31-45f5-a575-f617476e832a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-697c9f81-df31-45f5-a575-f617476e832a', 'volume_size': 1}
Apr 14 01:25:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:15 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe 1073741824" returned: 0 in 0.689s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Flow 'volume_create_manager' (1176da82-279b-46cc-a195-4c6401a44535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ec88f2-9d34-40b6-a32b-1fe1063dd237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ec88f2-9d34-40b6-a32b-1fe1063dd237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1024160942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde1e617-6ca3-4776-972d-ae3c1207921a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85931d5b27242189e4595e7045abf42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:15Z,use_quota=True,user_id='a2721b607d2b4acfb685b5aa5f228c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:15 devstack sudo[88429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe
Apr 14 01:25:15 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab967c99-c9a8-47fa-a36d-d867b4e73905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab967c99-c9a8-47fa-a36d-d867b4e73905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea289c9-94fe-412a-b651-6c77601f18f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea289c9-94fe-412a-b651-6c77601f18f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde1e617-6ca3-4776-972d-ae3c1207921a', 'volume_name': 'volume-cde1e617-6ca3-4776-972d-ae3c1207921a', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd1bee6-d408-49f8-a17e-47cf482f3b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd1bee6-d408-49f8-a17e-47cf482f3b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6825f86-3670-4c28-b7bc-b88b2a2257ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:15 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume cde1e617-6ca3-4776-972d-ae3c1207921a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde1e617-6ca3-4776-972d-ae3c1207921a', 'volume_size': 1}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:15 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f" returned: 0 in 0.595s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:15 devstack sudo[88434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f
Apr 14 01:25:15 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:15 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe" returned: 0 in 0.422s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.994s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-23569083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46107af-aad5-4181-84b7-b2f4cc327d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85931d5b27242189e4595e7045abf42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:14Z,use_quota=True,user_id='a2721b607d2b4acfb685b5aa5f228c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Creating volume a46107af-aad5-4181-84b7-b2f4cc327d78 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:25:15 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a46107af-aad5-4181-84b7-b2f4cc327d78 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93db4415-b97f-46e8-a903-007e7f5b865e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7e859d-5e66-4b20-9ab6-49055405e3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:15 devstack sudo[88437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a46107af-aad5-4181-84b7-b2f4cc327d78 1073741824
Apr 14 01:25:15 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:15 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe (7de4a233-7c3c-40bf-9488-18a4f7cb9efe): created successfully
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7e859d-5e66-4b20-9ab6-49055405e3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Flow 'volume_create_manager' (fcb3f532-06ff-45c4-8d98-e6fba509ae81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:15 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-402407d1-efa6-47e0-a686-d909e016724f tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Created volume successfully.
Apr 14 01:25:15 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-48c0ed9b-845b-44d9-ae6f-419b77e4363f" returned: 0 in 0.439s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Lock "cinder-quobyte-48c0ed9b-845b-44d9-ae6f-419b77e4363f" released by "delete_volume" :: held 1.060s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Created reservations ['ea63b881-0b13-461b-93b7-d529f774c81a', '730dd158-d185-40dc-b18a-2588854889cb', '068551f1-3389-4250-af3b-b2af0e4b94f3', '42ad2423-c40c-4a04-b715-961868f53e26'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:15 devstack sudo[88440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:25:15 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:16 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a46107af-aad5-4181-84b7-b2f4cc327d78 1073741824" returned: 0 in 0.536s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a46107af-aad5-4181-84b7-b2f4cc327d78 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:16 devstack sudo[88445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a46107af-aad5-4181-84b7-b2f4cc327d78
Apr 14 01:25:16 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:16 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.440s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:25:16 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Deleted volume successfully.
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-35761879-ba1f-4039-9b24-d318940a0137 tempest-VolumesTransfersV357Test-1195554777 None] Lock "cinder-48c0ed9b-845b-44d9-ae6f-419b77e4363f-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:16 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a46107af-aad5-4181-84b7-b2f4cc327d78" returned: 0 in 0.435s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.818s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1805385814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d91939b-d9ce-4dbc-9c6f-7c0345d626e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85931d5b27242189e4595e7045abf42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:15Z,use_quota=True,user_id='a2721b607d2b4acfb685b5aa5f228c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Creating volume 8d91939b-d9ce-4dbc-9c6f-7c0345d626e4 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:25:16 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39a6c70-99bd-444b-b563-e00a39a25123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46107af-aad5-4181-84b7-b2f4cc327d78', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ad8d41-e6ab-4e26-b99b-84c28335443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:16 devstack sudo[88449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4 1073741824
Apr 14 01:25:16 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:16 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume volume-a46107af-aad5-4181-84b7-b2f4cc327d78 (a46107af-aad5-4181-84b7-b2f4cc327d78): created successfully
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ad8d41-e6ab-4e26-b99b-84c28335443d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Flow 'volume_create_manager' (f70dd185-4551-4409-b84f-8b50b269e5f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:16 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2710c2cc-9742-41ee-adc7-02f692e2d67c tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Created volume successfully.
Apr 14 01:25:17 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4 1073741824" returned: 0 in 0.523s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:17 devstack sudo[88454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4
Apr 14 01:25:17 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:17 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4" returned: 0 in 0.519s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.675s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-378756290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697c9f81-df31-45f5-a575-f617476e832a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85931d5b27242189e4595e7045abf42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:15Z,use_quota=True,user_id='a2721b607d2b4acfb685b5aa5f228c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Creating volume 697c9f81-df31-45f5-a575-f617476e832a {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:25:17 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-697c9f81-df31-45f5-a575-f617476e832a 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097df14b-954d-488b-9385-0e0a4484ee58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:17 devstack sudo[88459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-697c9f81-df31-45f5-a575-f617476e832a 1073741824
Apr 14 01:25:17 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be3e869-6815-4216-afdf-f84a5acf40cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:17 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4 (8d91939b-d9ce-4dbc-9c6f-7c0345d626e4): created successfully
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be3e869-6815-4216-afdf-f84a5acf40cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:17 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Flow 'volume_create_manager' (615568d9-318f-427b-941c-6da9797adffb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:17 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-48386213-e104-4120-b2aa-3ea560899bf2 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Created volume successfully.
Apr 14 01:25:18 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-697c9f81-df31-45f5-a575-f617476e832a 1073741824" returned: 0 in 0.563s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-697c9f81-df31-45f5-a575-f617476e832a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:18 devstack sudo[88464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-697c9f81-df31-45f5-a575-f617476e832a
Apr 14 01:25:18 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:18 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-697c9f81-df31-45f5-a575-f617476e832a" returned: 0 in 0.467s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.521s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1024160942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde1e617-6ca3-4776-972d-ae3c1207921a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85931d5b27242189e4595e7045abf42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:15Z,use_quota=True,user_id='a2721b607d2b4acfb685b5aa5f228c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Creating volume cde1e617-6ca3-4776-972d-ae3c1207921a {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:25:18 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cde1e617-6ca3-4776-972d-ae3c1207921a 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5f8e9b-6c31-4044-95ef-c303d510df2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-697c9f81-df31-45f5-a575-f617476e832a', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78554a3-b001-4e8e-9fc9-bbf50618c3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:18 devstack sudo[88467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cde1e617-6ca3-4776-972d-ae3c1207921a 1073741824
Apr 14 01:25:18 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:18 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume volume-697c9f81-df31-45f5-a575-f617476e832a (697c9f81-df31-45f5-a575-f617476e832a): created successfully
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78554a3-b001-4e8e-9fc9-bbf50618c3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:18 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Flow 'volume_create_manager' (3d2350ae-631d-45f4-868a-22652df4138e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:18 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-4f221236-1fca-4c74-9413-571dc3b409be tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Created volume successfully.
Apr 14 01:25:19 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cde1e617-6ca3-4776-972d-ae3c1207921a 1073741824" returned: 0 in 0.534s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cde1e617-6ca3-4776-972d-ae3c1207921a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:19 devstack sudo[88472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cde1e617-6ca3-4776-972d-ae3c1207921a
Apr 14 01:25:19 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:19 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cde1e617-6ca3-4776-972d-ae3c1207921a" returned: 0 in 0.500s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:25:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:19 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6825f86-3670-4c28-b7bc-b88b2a2257ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde1e617-6ca3-4776-972d-ae3c1207921a', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:19 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92463e12-8d1d-4b97-b081-6db5c70a2672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:19 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Volume volume-cde1e617-6ca3-4776-972d-ae3c1207921a (cde1e617-6ca3-4776-972d-ae3c1207921a): created successfully
Apr 14 01:25:19 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92463e12-8d1d-4b97-b081-6db5c70a2672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:19 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Flow 'volume_create_manager' (1176da82-279b-46cc-a195-4c6401a44535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:19 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ce914631-666d-44c2-b1a0-b44eef374d15 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Created volume successfully.
Apr 14 01:25:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "cinder-cde1e617-6ca3-4776-972d-ae3c1207921a-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-cde1e617-6ca3-4776-972d-ae3c1207921a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "cinder-quobyte-cde1e617-6ca3-4776-972d-ae3c1207921a" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-quobyte-cde1e617-6ca3-4776-972d-ae3c1207921a" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:20 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a90a5e-39e7-4380-af30-a89706fb1787]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cde1e617-6ca3-4776-972d-ae3c1207921a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:20 devstack sudo[88475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cde1e617-6ca3-4776-972d-ae3c1207921a
Apr 14 01:25:20 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:21 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cde1e617-6ca3-4776-972d-ae3c1207921a" returned: 0 in 0.528s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cde1e617-6ca3-4776-972d-ae3c1207921a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:21 devstack sudo[88480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cde1e617-6ca3-4776-972d-ae3c1207921a
Apr 14 01:25:21 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:21 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-cde1e617-6ca3-4776-972d-ae3c1207921a" returned: 0 in 0.424s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-quobyte-cde1e617-6ca3-4776-972d-ae3c1207921a" released by "delete_volume" :: held 0.990s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Created reservations ['934b8b3f-ae27-4a72-ba44-22b54658e7b7', 'a758e12d-9019-4ff0-91b9-fc1a412cea9b', '561ee07b-701c-45d1-b8bb-eff45af35951', '17125188-c13a-46d6-a0fe-399b19f73932'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:21 devstack sudo[88483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:25:21 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "cinder-697c9f81-df31-45f5-a575-f617476e832a-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-697c9f81-df31-45f5-a575-f617476e832a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "cinder-quobyte-697c9f81-df31-45f5-a575-f617476e832a" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-quobyte-697c9f81-df31-45f5-a575-f617476e832a" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[22949f91-ffda-4f0e-9025-f2b33df6ef29]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-697c9f81-df31-45f5-a575-f617476e832a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:21 devstack sudo[88485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-697c9f81-df31-45f5-a575-f617476e832a
Apr 14 01:25:21 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:22 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.476s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:22 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:25:22 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Deleted volume successfully.
Apr 14 01:25:22 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-133a3fe4-a561-4b36-9601-0837e7526748 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-cde1e617-6ca3-4776-972d-ae3c1207921a-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:22 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-697c9f81-df31-45f5-a575-f617476e832a" returned: 0 in 0.515s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-697c9f81-df31-45f5-a575-f617476e832a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:22 devstack sudo[88491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-697c9f81-df31-45f5-a575-f617476e832a
Apr 14 01:25:22 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:22 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-697c9f81-df31-45f5-a575-f617476e832a" returned: 0 in 0.458s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:22 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-quobyte-697c9f81-df31-45f5-a575-f617476e832a" released by "delete_volume" :: held 0.994s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:22 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Created reservations ['5741edb5-ed4d-4508-9e4e-f5c4f8cdd470', 'f97ddeca-7372-4328-9600-fa906ee9e4e9', '9c227251-6a2b-4869-95f7-b3a3ffca613b', 'a4a0cc7c-6cd0-4d04-9c75-7259512261c3'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:23 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "cinder-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:23 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:23 devstack sudo[88494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:25:23 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:23 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "cinder-quobyte-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:23 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-quobyte-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4" acquired by "delete_volume" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:23 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f09414-ad39-410f-a76f-b2aa340cebd1]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:23 devstack sudo[88496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4
Apr 14 01:25:23 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:23 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.535s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:23 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:25:23 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Deleted volume successfully.
Apr 14 01:25:23 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1141f166-406e-4eac-9ce2-8b42149d89c1 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-697c9f81-df31-45f5-a575-f617476e832a-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:23 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4" returned: 0 in 0.580s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:23 devstack sudo[88502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4
Apr 14 01:25:23 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:24 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4" returned: 0 in 0.471s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:24 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-quobyte-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4" released by "delete_volume" :: held 1.072s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:24 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Created reservations ['87ba932d-e611-4a95-b354-267df076e209', '15d3ba52-8ff8-481a-913c-81dae9f11dad', '4bdca6be-9ad4-4cbb-bef0-a09ed21130bc', '9dd14ef6-6fa7-4fad-bcca-192825760575'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:24 devstack sudo[88505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:25:24 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:24 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.436s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:24 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:25:24 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Deleted volume successfully.
Apr 14 01:25:24 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a33cdf24-6231-4402-b21d-acb0b783d3ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-8d91939b-d9ce-4dbc-9c6f-7c0345d626e4-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:25 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "cinder-a46107af-aad5-4181-84b7-b2f4cc327d78-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:25 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-a46107af-aad5-4181-84b7-b2f4cc327d78-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:25 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "cinder-quobyte-a46107af-aad5-4181-84b7-b2f4cc327d78" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:25 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-quobyte-a46107af-aad5-4181-84b7-b2f4cc327d78" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:25 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46ecb40-4bd1-4f86-9cba-a084344d70c1]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a46107af-aad5-4181-84b7-b2f4cc327d78 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:25 devstack sudo[88508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a46107af-aad5-4181-84b7-b2f4cc327d78
Apr 14 01:25:25 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:25 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a46107af-aad5-4181-84b7-b2f4cc327d78" returned: 0 in 0.532s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a46107af-aad5-4181-84b7-b2f4cc327d78 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:25 devstack sudo[88513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a46107af-aad5-4181-84b7-b2f4cc327d78
Apr 14 01:25:25 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:26 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a46107af-aad5-4181-84b7-b2f4cc327d78" returned: 0 in 0.487s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-quobyte-a46107af-aad5-4181-84b7-b2f4cc327d78" released by "delete_volume" :: held 1.041s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Created reservations ['8e1bd54b-4bdb-4729-b9e8-a28117e3be1a', 'cb35d9bb-9be0-4348-817c-b86dec743ecb', '5cf3acd9-eaf8-4190-abf5-d1b375468721', '548af90e-9629-4967-a02e-651a4fa1f84e'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:26 devstack sudo[88516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:25:26 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Flow 'volume_create_manager' (7c5641a8-5d21-4cbe-beb8-2af3817f57cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10fd06d-9c1c-4073-96f9-1072b672b696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10fd06d-9c1c-4073-96f9-1072b672b696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-409425549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c274c8-d774-47d4-a36a-48b2372f54dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f48125791ac4b678a747971324f114c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:27Z,use_quota=True,user_id='6c84e3d1084a42358a70b81ef1920e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9647d47a-43f8-4739-a6da-5764cd0aeeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9647d47a-43f8-4739-a6da-5764cd0aeeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a8abd3-8e2c-4b1a-859d-4bfc93e01ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a8abd3-8e2c-4b1a-859d-4bfc93e01ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c274c8-d774-47d4-a36a-48b2372f54dd', 'volume_name': 'volume-56c274c8-d774-47d4-a36a-48b2372f54dd', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542724ab-0f45-42d9-bd87-f827de96ed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542724ab-0f45-42d9-bd87-f827de96ed6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4483672-14c7-46a0-a958-459f3c5b7aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:26 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Volume 56c274c8-d774-47d4-a36a-48b2372f54dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c274c8-d774-47d4-a36a-48b2372f54dd', 'volume_size': 1}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-409425549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c274c8-d774-47d4-a36a-48b2372f54dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f48125791ac4b678a747971324f114c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:27Z,use_quota=True,user_id='6c84e3d1084a42358a70b81ef1920e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Creating volume 56c274c8-d774-47d4-a36a-48b2372f54dd {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:25:26 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:26 devstack sudo[88519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd 1073741824
Apr 14 01:25:26 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:26 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.444s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:25:26 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Deleted volume successfully.
Apr 14 01:25:26 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-074d4cf4-598e-46fc-8177-f936f31880d6 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-a46107af-aad5-4181-84b7-b2f4cc327d78-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:27 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd 1073741824" returned: 0 in 0.495s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:27 devstack sudo[88524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd
Apr 14 01:25:27 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "cinder-7de4a233-7c3c-40bf-9488-18a4f7cb9efe-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-7de4a233-7c3c-40bf-9488-18a4f7cb9efe-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "cinder-quobyte-7de4a233-7c3c-40bf-9488-18a4f7cb9efe" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-quobyte-7de4a233-7c3c-40bf-9488-18a4f7cb9efe" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[316fd967-bc75-4aef-a728-dd4e423b0291]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:27 devstack sudo[88527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe
Apr 14 01:25:27 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:27 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd" returned: 0 in 0.430s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4483672-14c7-46a0-a958-459f3c5b7aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c274c8-d774-47d4-a36a-48b2372f54dd', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491e6605-3984-4ea1-8591-a3c7438832f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:27 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Volume volume-56c274c8-d774-47d4-a36a-48b2372f54dd (56c274c8-d774-47d4-a36a-48b2372f54dd): created successfully
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491e6605-3984-4ea1-8591-a3c7438832f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Flow 'volume_create_manager' (7c5641a8-5d21-4cbe-beb8-2af3817f57cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:27 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b43df491-72f0-4a74-98b2-b3361a3c3c71 tempest-VolumesActionsTest-808355461 None] Created volume successfully.
Apr 14 01:25:27 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe" returned: 0 in 0.490s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:27 devstack sudo[88533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe
Apr 14 01:25:27 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:28 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7de4a233-7c3c-40bf-9488-18a4f7cb9efe" returned: 0 in 0.428s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-quobyte-7de4a233-7c3c-40bf-9488-18a4f7cb9efe" released by "delete_volume" :: held 0.968s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Created reservations ['dd1bc95e-c6f8-45c0-b2ca-3830eb12de08', 'ecc173d0-d8c0-4ad5-81ec-67ce813b7f54', '0d4f1c11-95e7-4387-bf42-40e84cc48263', 'd61ca1d4-c5d1-4238-ba22-e36179e44a9e'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:28 devstack sudo[88536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:25:28 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "cinder-736ace49-d1e8-441d-80c6-6e4bb5558350-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-736ace49-d1e8-441d-80c6-6e4bb5558350-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "cinder-quobyte-736ace49-d1e8-441d-80c6-6e4bb5558350" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-quobyte-736ace49-d1e8-441d-80c6-6e4bb5558350" acquired by "delete_volume" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca38630-7c31-4f2f-bafa-3cd4c593db6b]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-736ace49-d1e8-441d-80c6-6e4bb5558350 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:28 devstack sudo[88538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-736ace49-d1e8-441d-80c6-6e4bb5558350
Apr 14 01:25:28 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:28 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.441s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:25:28 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Deleted volume successfully.
Apr 14 01:25:28 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f045d657-32a7-4124-a5b8-a438f5139269 tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-7de4a233-7c3c-40bf-9488-18a4f7cb9efe-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:29 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-736ace49-d1e8-441d-80c6-6e4bb5558350" returned: 0 in 0.539s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-736ace49-d1e8-441d-80c6-6e4bb5558350 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:29 devstack sudo[88544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-736ace49-d1e8-441d-80c6-6e4bb5558350
Apr 14 01:25:29 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:29 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-736ace49-d1e8-441d-80c6-6e4bb5558350" returned: 0 in 0.454s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-quobyte-736ace49-d1e8-441d-80c6-6e4bb5558350" released by "delete_volume" :: held 1.019s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:29 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Created reservations ['cc0fea72-2732-4943-93b7-5681fa2f77cd', '3c4a706e-07f7-4ccf-9c1b-53c7835ddbac', 'ef2e392e-8488-401f-93ff-3960b83a8567', '5317a87e-725a-4ed6-8338-d785bfc2508c'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:29 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:29 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:29 devstack sudo[88549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:25:29 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:30 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.405s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:30 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:25:30 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Deleted volume successfully.
Apr 14 01:25:30 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8b551885-14e4-4531-9890-2c1491dbd9ea tempest-CreateVolumesFromSourceVolumeTest-999369216 None] Lock "cinder-736ace49-d1e8-441d-80c6-6e4bb5558350-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:39 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:SELECT=119,cinder:UPDATE=164,cinder:INSERT=41,cinder:DELETE=12 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:25:40 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:UPDATE=173,cinder:SELECT=114,cinder:INSERT=41,cinder:DELETE=16 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Flow 'volume_create_manager' (610c336c-a513-496f-8f3f-8963a1de32b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef73f5e-3abc-4dfb-9dd8-e3f8fa73b1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef73f5e-3abc-4dfb-9dd8-e3f8fa73b1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1148029915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07819ddd-8d56-4d91-9632-8203fc9f34dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbed622f345c4117b469aa020a4cf262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:45Z,use_quota=True,user_id='fcf1216d17734e1ca6de74cff058f43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020b80e5-14e5-4864-95d7-8dc4c994a2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020b80e5-14e5-4864-95d7-8dc4c994a2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfef8930-ea2a-4542-90c4-1ee08796b5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfef8930-ea2a-4542-90c4-1ee08796b5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07819ddd-8d56-4d91-9632-8203fc9f34dd', 'volume_name': 'volume-07819ddd-8d56-4d91-9632-8203fc9f34dd', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d31bd56-f978-4560-bc1b-d3ab10c29776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d31bd56-f978-4560-bc1b-d3ab10c29776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de58bcce-deb6-4c50-981c-3f1615179395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:44 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Volume 07819ddd-8d56-4d91-9632-8203fc9f34dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07819ddd-8d56-4d91-9632-8203fc9f34dd', 'volume_size': 1}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1148029915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07819ddd-8d56-4d91-9632-8203fc9f34dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbed622f345c4117b469aa020a4cf262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:45Z,use_quota=True,user_id='fcf1216d17734e1ca6de74cff058f43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Creating volume 07819ddd-8d56-4d91-9632-8203fc9f34dd {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:25:44 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:25:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:44 devstack sudo[88600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd 1073741824
Apr 14 01:25:44 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:45 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd 1073741824" returned: 0 in 0.698s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:45 devstack sudo[88606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd
Apr 14 01:25:45 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:46 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd" returned: 0 in 0.477s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:25:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de58bcce-deb6-4c50-981c-3f1615179395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07819ddd-8d56-4d91-9632-8203fc9f34dd', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd690348-c8a4-4f60-80cb-102826db2e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:46 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Volume volume-07819ddd-8d56-4d91-9632-8203fc9f34dd (07819ddd-8d56-4d91-9632-8203fc9f34dd): created successfully
Apr 14 01:25:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd690348-c8a4-4f60-80cb-102826db2e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Flow 'volume_create_manager' (610c336c-a513-496f-8f3f-8963a1de32b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:46 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e638604f-c7df-4a87-b337-7829d430d0f7 tempest-SnapshotDependencyTests-773562348 None] Created volume successfully.
Apr 14 01:25:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-96965904-930e-4cac-bf7a-3e8470556f4c tempest-VolumesActionsTest-808355461 None] Acquiring lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd" by "attach_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-96965904-930e-4cac-bf7a-3e8470556f4c tempest-VolumesActionsTest-808355461 None] Lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd" acquired by "attach_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:46 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-96965904-930e-4cac-bf7a-3e8470556f4c tempest-VolumesActionsTest-808355461 None] Attaching volume 56c274c8-d774-47d4-a36a-48b2372f54dd to instance 7897b686-f9f7-4fb5-8c2d-35273ff0c95c at mountpoint /dev/vdb on host None.
Apr 14 01:25:46 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-96965904-930e-4cac-bf7a-3e8470556f4c tempest-VolumesActionsTest-808355461 None] Attach volume completed successfully.
Apr 14 01:25:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-96965904-930e-4cac-bf7a-3e8470556f4c tempest-VolumesActionsTest-808355461 None] Lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd" released by "attach_volume" :: held 0.075s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6209b7c9-5eda-462c-a7e0-3ca85d171b7f tempest-VolumesActionsTest-808355461 None] Acquiring lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd-detach_volume" by "detach_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6209b7c9-5eda-462c-a7e0-3ca85d171b7f tempest-VolumesActionsTest-808355461 None] Lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:47 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-6209b7c9-5eda-462c-a7e0-3ca85d171b7f tempest-VolumesActionsTest-808355461 None] Detaching volume 56c274c8-d774-47d4-a36a-48b2372f54dd from instance 7897b686-f9f7-4fb5-8c2d-35273ff0c95c.
Apr 14 01:25:47 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-6209b7c9-5eda-462c-a7e0-3ca85d171b7f tempest-VolumesActionsTest-808355461 None] Detach volume completed successfully.
Apr 14 01:25:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-6209b7c9-5eda-462c-a7e0-3ca85d171b7f tempest-VolumesActionsTest-808355461 None] Lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:47 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] Creating offline snapshot 0e7e2924-59a9-4e68-b7a0-31a51c8553d0 of volume 07819ddd-8d56-4d91-9632-8203fc9f34dd {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:25:47 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed48d2b-b079-4b33-99cd-0569fa7dfcc7]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:47 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd
Apr 14 01:25:47 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:47 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd" returned: 0 in 0.501s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:47 devstack sudo[88615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0 1G
Apr 14 01:25:47 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:48 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0 1G" returned: 0 in 0.533s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07819ddd-8d56-4d91-9632-8203fc9f34dd -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:48 devstack sudo[88620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07819ddd-8d56-4d91-9632-8203fc9f34dd -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0
Apr 14 01:25:48 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:48 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07819ddd-8d56-4d91-9632-8203fc9f34dd -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0" returned: 0 in 0.437s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:48 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0 is being set with open permissions: ugo+rw
Apr 14 01:25:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:48 devstack sudo[88625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0
Apr 14 01:25:48 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:49 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0" returned: 0 in 0.450s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:49 devstack sudo[88650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.info
Apr 14 01:25:49 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:49 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.info" returned: 0 in 0.411s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:49 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.info is being set with open permissions: ugo+rw
Apr 14 01:25:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:49 devstack sudo[88653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.info
Apr 14 01:25:49 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:49 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.info" returned: 0 in 0.405s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.802s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:49 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-a6ac3b23-f648-4e8e-b3ec-3c77765b0559 tempest-SnapshotDependencyTests-773562348 None] Create snapshot completed successfully
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Flow 'volume_create_manager' (c8e62140-6ce5-4e73-9933-cfa641da5b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b651a3-9030-4658-8992-3b0c690d4d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b651a3-9030-4658-8992-3b0c690d4d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbed622f345c4117b469aa020a4cf262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0e7e2924-59a9-4e68-b7a0-31a51c8553d0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:25:51Z,use_quota=True,user_id='fcf1216d17734e1ca6de74cff058f43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a77c6b-7050-404c-805b-3cfd8c85a9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a77c6b-7050-404c-805b-3cfd8c85a9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0876699c-b3f6-4c38-93b4-2750250c36dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0876699c-b3f6-4c38-93b4-2750250c36dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73', 'volume_name': 'volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73', 'volume_size': 1, 'snapshot_id': '0e7e2924-59a9-4e68-b7a0-31a51c8553d0'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e1f618-fa0c-416c-b1ae-456f12e16f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e1f618-fa0c-416c-b1ae-456f12e16f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45384d2-c574-476a-8309-dd8c4c201815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:50 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Volume 30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73', 'volume_size': 1, 'snapshot_id': '0e7e2924-59a9-4e68-b7a0-31a51c8553d0'}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "cinder-quobyte-0e7e2924-59a9-4e68-b7a0-31a51c8553d0-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73" by "_create_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-quobyte-0e7e2924-59a9-4e68-b7a0-31a51c8553d0-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Creating volume 30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73 from snapshot 0e7e2924-59a9-4e68-b7a0-31a51c8553d0 {{(pid=81812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "cinder-quobyte-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73" by "_copy_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-quobyte-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] snapshot: 0e7e2924-59a9-4e68-b7a0-31a51c8553d0, volume: 30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73,  {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8800a9bf-c9c8-4388-b424-cc4d2e33c203]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:50 devstack sudo[88657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0
Apr 14 01:25:50 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:51 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0" returned: 0 in 0.485s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07819ddd-8d56-4d91-9632-8203fc9f34dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:25:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 14 01:25:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Creating direct copy from snapshot {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 14 01:25:51 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ed9068-d1d7-4927-8c0e-022d25e3f557]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:51 devstack sudo[88662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd
Apr 14 01:25:51 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:51 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd" returned: 0 in 0.512s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:51 devstack cinder-volume[81812]: DEBUG cinder.utils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Path /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73 not found in is_blk_device check {{(pid=81812) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 14 01:25:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:51 devstack sudo[88667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73
Apr 14 01:25:51 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:53 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73" returned: 0 in 2.173s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:53 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e45189-466f-4fb8-9933-0d714e5a31ae]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:53 devstack sudo[88679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd
Apr 14 01:25:53 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:54 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd" returned: 0 in 0.589s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:54 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73 {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:25:54 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Converted 1024.00 MB image at 470.93 MB/s
Apr 14 01:25:54 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73 is being set with open permissions: ugo+rw
Apr 14 01:25:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:54 devstack sudo[88684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73
Apr 14 01:25:54 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:54 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73" returned: 0 in 0.443s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-quobyte-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73" released by "_copy_volume_from_snapshot" :: held 4.255s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-quobyte-0e7e2924-59a9-4e68-b7a0-31a51c8553d0-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73" released by "_create_volume_from_snapshot" :: held 4.271s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.281s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45384d2-c574-476a-8309-dd8c4c201815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73', 'volume_size': 1, 'snapshot_id': '0e7e2924-59a9-4e68-b7a0-31a51c8553d0'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bb0be1-811a-48aa-aa44-8572d7c48ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:25:54 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Volume volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73 (30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73): created successfully
Apr 14 01:25:54 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bb0be1-811a-48aa-aa44-8572d7c48ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:25:55 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Flow 'volume_create_manager' (c8e62140-6ce5-4e73-9933-cfa641da5b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:25:55 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8a81a49b-bd63-4961-a6aa-447c24649f2d tempest-SnapshotDependencyTests-773562348 None] Created volume successfully.
Apr 14 01:25:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "cinder-0e7e2924-59a9-4e68-b7a0-31a51c8553d0-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-0e7e2924-59a9-4e68-b7a0-31a51c8553d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "cinder-quobyte-07819ddd-8d56-4d91-9632-8203fc9f34dd" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-quobyte-07819ddd-8d56-4d91-9632-8203fc9f34dd" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "cinder-quobyte-0e7e2924-59a9-4e68-b7a0-31a51c8553d0" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-quobyte-0e7e2924-59a9-4e68-b7a0-31a51c8553d0" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Deleting offline snapshot 0e7e2924-59a9-4e68-b7a0-31a51c8553d0 of volume 07819ddd-8d56-4d91-9632-8203fc9f34dd {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:25:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] snapshot_file for this snap is: volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:25:56 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bb4f9d-bcd5-45d5-90b1-581658b5c5f9]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:56 devstack sudo[88689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0
Apr 14 01:25:56 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:56 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0" returned: 0 in 0.471s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07819ddd-8d56-4d91-9632-8203fc9f34dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:25:56 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fc42f8-52a0-4837-9aed-d9b382c21d2f]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:56 devstack sudo[88694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd
Apr 14 01:25:56 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:57 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd" returned: 0 in 0.498s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:57 devstack sudo[88699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0
Apr 14 01:25:57 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:57 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0" returned: 0 in 0.450s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:57 devstack sudo[88705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0
Apr 14 01:25:57 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:57 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd.0e7e2924-59a9-4e68-b7a0-31a51c8553d0" returned: 0 in 0.427s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-quobyte-0e7e2924-59a9-4e68-b7a0-31a51c8553d0" released by "_delete_snapshot" :: held 1.901s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:57 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-quobyte-07819ddd-8d56-4d91-9632-8203fc9f34dd" released by "delete_snapshot" :: held 1.913s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:57 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Created reservations ['ea528e24-1c70-4db8-8fd9-a8688b861cbe', '5a3bf198-e598-4b85-8794-2618dfc86e59', '72a56ae8-6038-4268-ba84-485e23ade795', 'b5a155d2-cac1-4e1c-8ad0-f99eeaa7cc1a'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:58 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Delete snapshot completed successfully.
Apr 14 01:25:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ff863223-a2e9-48bc-a38a-6f1d91dc8ed4 tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-0e7e2924-59a9-4e68-b7a0-31a51c8553d0-delete_snapshot" released by "delete_snapshot" :: held 2.009s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "cinder-07819ddd-8d56-4d91-9632-8203fc9f34dd-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-07819ddd-8d56-4d91-9632-8203fc9f34dd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "cinder-quobyte-07819ddd-8d56-4d91-9632-8203fc9f34dd" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-quobyte-07819ddd-8d56-4d91-9632-8203fc9f34dd" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:58 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc77007-4a23-4232-bffe-f04d8c0dfc10]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:58 devstack sudo[88708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd
Apr 14 01:25:58 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:58 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd" returned: 0 in 0.466s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:58 devstack sudo[88713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd
Apr 14 01:25:58 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:59 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-07819ddd-8d56-4d91-9632-8203fc9f34dd" returned: 0 in 0.436s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-quobyte-07819ddd-8d56-4d91-9632-8203fc9f34dd" released by "delete_volume" :: held 0.933s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Created reservations ['36e6f99e-6eaf-41a0-9f39-b9815a4edd3c', 'a1449576-1125-4a81-9eb4-102c7f4cd986', 'be1b331a-c296-48b3-af54-b06adc3fb707', 'dae8cfee-a8a4-40be-a6dd-a0f93ba16a24'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:59 devstack sudo[88716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:25:59 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "cinder-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "cinder-quobyte-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-quobyte-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bf66f1-9ea1-4291-860a-f13a6660ad84]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:59 devstack sudo[88718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73
Apr 14 01:25:59 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:25:59 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.432s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:25:59 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Deleted volume successfully.
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-fddf7036-cc54-4e56-ad58-c5d62ad80000 tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-07819ddd-8d56-4d91-9632-8203fc9f34dd-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:25:59 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73" returned: 0 in 0.543s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:25:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:25:59 devstack sudo[88725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73
Apr 14 01:25:59 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:00 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73" returned: 0 in 0.463s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:00 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-quobyte-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73" released by "delete_volume" :: held 1.066s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:26:00 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Created reservations ['885a5339-66cb-4d40-b669-842211b08740', '96ecec1e-7e9a-4d2a-9553-439d6e200f73', 'af638a05-f567-427b-8419-8daad508cbbc', 'dd09ab19-99fc-412d-8d2d-7d797f3715d5'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:26:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:26:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:26:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:26:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:00 devstack sudo[88728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:26:00 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:00 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.483s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:00 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:26:00 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Deleted volume successfully.
Apr 14 01:26:00 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e75fbeec-8c24-4bd3-9758-88f8dd251bac tempest-SnapshotDependencyTests-773562348 None] Lock "cinder-30a8d57f-a1c1-4866-9ebd-bb9d81fd9f73-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:26:03 devstack cinder-volume[81812]: DEBUG oslo_service.periodic_task [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81812) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:26:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:26:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:26:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:26:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:04 devstack sudo[88749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:26:04 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:04 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.452s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:04 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:26:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4493a367-375d-457e-bdb4-eba95d91346c tempest-VolumesActionsTest-808355461 None] Acquiring lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd" by "attach_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:26:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4493a367-375d-457e-bdb4-eba95d91346c tempest-VolumesActionsTest-808355461 None] Lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd" acquired by "attach_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:26:08 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-4493a367-375d-457e-bdb4-eba95d91346c tempest-VolumesActionsTest-808355461 None] Attaching volume 56c274c8-d774-47d4-a36a-48b2372f54dd to instance 91f9fc25-dcd2-4edc-b85d-8fd2aef2aea6 at mountpoint /dev/vdb on host None.
Apr 14 01:26:08 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-4493a367-375d-457e-bdb4-eba95d91346c tempest-VolumesActionsTest-808355461 None] Attach volume completed successfully.
Apr 14 01:26:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4493a367-375d-457e-bdb4-eba95d91346c tempest-VolumesActionsTest-808355461 None] Lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd" released by "attach_volume" :: held 0.067s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:26:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9ce2e8ca-6716-4128-9e8c-239128081565 tempest-VolumesActionsTest-808355461 None] Acquiring lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd-detach_volume" by "detach_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:26:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9ce2e8ca-6716-4128-9e8c-239128081565 tempest-VolumesActionsTest-808355461 None] Lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd-detach_volume" acquired by "detach_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:26:09 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9ce2e8ca-6716-4128-9e8c-239128081565 tempest-VolumesActionsTest-808355461 None] Detaching volume 56c274c8-d774-47d4-a36a-48b2372f54dd from instance 91f9fc25-dcd2-4edc-b85d-8fd2aef2aea6.
Apr 14 01:26:09 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9ce2e8ca-6716-4128-9e8c-239128081565 tempest-VolumesActionsTest-808355461 None] Detach volume completed successfully.
Apr 14 01:26:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9ce2e8ca-6716-4128-9e8c-239128081565 tempest-VolumesActionsTest-808355461 None] Lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:26:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:17 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8918159-fac8-4b8c-ac58-7cc21ffe9070]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:17 devstack sudo[88852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd
Apr 14 01:26:17 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:18 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd" returned: 0 in 0.479s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:18 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5b474a-a707-4ca8-ae23-11b7282783f2]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:18 devstack sudo[88857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd
Apr 14 01:26:18 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:18 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd" returned: 0 in 0.475s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.f4b83bae-ffef-4661-8f9d-e60e26e3c47dxb6bqueb.img {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:18 devstack sudo[88862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.f4b83bae-ffef-4661-8f9d-e60e26e3c47dxb6bqueb.img
Apr 14 01:26:18 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:19 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:SELECT=39,cinder:UPDATE=37,cinder:INSERT=12,cinder:DELETE=3 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:26:20 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.f4b83bae-ffef-4661-8f9d-e60e26e3c47dxb6bqueb.img" returned: 0 in 1.928s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:20 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1152fcc5-9f72-4737-9a46-820d7fbc80ad]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:20 devstack sudo[88874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd
Apr 14 01:26:20 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:21 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd" returned: 0 in 0.606s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:21 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.f4b83bae-ffef-4661-8f9d-e60e26e3c47dxb6bqueb.img {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:26:21 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] Converted 1024.00 MB image at 530.85 MB/s
Apr 14 01:26:21 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] f4b83bae-ffef-4661-8f9d-e60e26e3c47d was raw, no need to convert to raw {{(pid=81812) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 14 01:26:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.981s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:26:30 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] Uploaded volume to glance image-id: f4b83bae-ffef-4661-8f9d-e60e26e3c47d. {{(pid=81812) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 14 01:26:30 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-7eb56706-72a8-480d-ad8f-b0ba29340ecb tempest-VolumesActionsTest-808355461 None] Copy volume to image completed successfully.
Apr 14 01:26:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:31 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47fa15b-7e75-4fc8-8602-7262f1219246]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:31 devstack sudo[88880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd
Apr 14 01:26:31 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:32 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd" returned: 0 in 0.462s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:32 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bf5a7b-3e7f-4856-8b97-7c1bd6a8f8cb]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:32 devstack sudo[88885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd
Apr 14 01:26:32 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:32 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd" returned: 0 in 0.462s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:32 devstack sudo[88890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img
Apr 14 01:26:32 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:34 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img" returned: 0 in 1.815s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:34 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee30e7b-7fa8-46bf-b0d6-7430b2543dae]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:34 devstack sudo[88902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd
Apr 14 01:26:34 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:35 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd" returned: 0 in 0.582s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:35 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd, size 1024.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:26:35 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Converted 1024.00 MB image at 563.72 MB/s
Apr 14 01:26:35 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] 8f6c0817-eced-4517-8be7-cc1620f93670 was raw, converting to qcow2 {{(pid=81812) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 14 01:26:35 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdd15ce-2b3e-41bc-a013-308d9b9eafce]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:35 devstack sudo[88909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img
Apr 14 01:26:35 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:35 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img" returned: 0 in 0.492s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:35 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img
Apr 14 01:26:35 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:36 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img" returned: 1 in 0.480s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:26:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img /opt/stack/data/cinder/conversion/vol_upload_i_zizasq {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:36 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img /opt/stack/data/cinder/conversion/vol_upload_i_zizasq
Apr 14 01:26:36 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:36 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img /opt/stack/data/cinder/conversion/vol_upload_i_zizasq" returned: 0 in 0.419s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:36 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Image conversion details: src /opt/stack/data/cinder/conversion/56c274c8-d774-47d4-a36a-48b2372f54dd.temp_image.8f6c0817-eced-4517-8be7-cc1620f93670fg_7n6un.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_i_zizasq {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:26:36 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 14 01:26:36 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[12898a97-b1a8-4849-b853-3375ac768e98]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i_zizasq {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:36 devstack sudo[88923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i_zizasq
Apr 14 01:26:36 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:36 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i_zizasq" returned: 0 in 0.455s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.027s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:26:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Uploaded volume to glance image-id: 8f6c0817-eced-4517-8be7-cc1620f93670. {{(pid=81812) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 14 01:26:37 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b098df1c-8eed-45b4-bf76-f57498fb16ae tempest-VolumesActionsTest-808355461 None] Copy volume to image completed successfully.
Apr 14 01:26:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Acquiring lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:26:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:26:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Acquiring lock "cinder-quobyte-56c274c8-d774-47d4-a36a-48b2372f54dd" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:26:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Lock "cinder-quobyte-56c274c8-d774-47d4-a36a-48b2372f54dd" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:26:38 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[548bfb6a-5856-4841-9e58-f5938b8b1fbd]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:38 devstack sudo[88929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd
Apr 14 01:26:38 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:38 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd" returned: 0 in 0.489s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:38 devstack sudo[88934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd
Apr 14 01:26:38 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:39 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-56c274c8-d774-47d4-a36a-48b2372f54dd" returned: 0 in 0.412s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Lock "cinder-quobyte-56c274c8-d774-47d4-a36a-48b2372f54dd" released by "delete_volume" :: held 0.923s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:26:39 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Created reservations ['62b6c80a-4f12-419c-8eba-2a77ee7eeb10', '6eb48ef4-2b79-4345-a53b-903f87daae42', '59d5214b-c2d0-4d43-84c4-e8990e2dee8b', '22177e75-00cf-49b7-9307-a3b0827e0b75'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:26:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:39 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:26:39 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:26:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:26:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:39 devstack sudo[88937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:26:39 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:39 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.419s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:39 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:26:39 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Deleted volume successfully.
Apr 14 01:26:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3617df42-049f-4c15-bfad-dba751f5ae91 tempest-VolumesActionsTest-808355461 None] Lock "cinder-56c274c8-d774-47d4-a36a-48b2372f54dd-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:UPDATE=42,cinder:SELECT=46,cinder:INSERT=8,cinder:DELETE=2 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Flow 'volume_create_manager' (65ec711a-011b-4457-bc79-145f02a2dbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42454773-dacb-45a6-ad7b-cb286fb4f744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42454773-dacb-45a6-ad7b-cb286fb4f744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-768084985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5020eecf-0b02-418a-a9c7-f0b393f438dc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f678773e3bd84846a31ac4fb87f85a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:26:43Z,use_quota=True,user_id='c86cb4eb2356435f9b57393e70bdf615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5c506d-2090-482d-8385-493d65745cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5c506d-2090-482d-8385-493d65745cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfee82c7-889f-490e-8416-7dd1a80cc354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfee82c7-889f-490e-8416-7dd1a80cc354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5020eecf-0b02-418a-a9c7-f0b393f438dc', 'volume_name': 'volume-5020eecf-0b02-418a-a9c7-f0b393f438dc', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c3de29-3aaf-4c98-9bee-39e194cf93fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c3de29-3aaf-4c98-9bee-39e194cf93fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf70e6c8-18e5-4a75-9df4-461f174ff469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:43 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Volume 5020eecf-0b02-418a-a9c7-f0b393f438dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5020eecf-0b02-418a-a9c7-f0b393f438dc', 'volume_size': 1}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-768084985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5020eecf-0b02-418a-a9c7-f0b393f438dc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f678773e3bd84846a31ac4fb87f85a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:26:43Z,use_quota=True,user_id='c86cb4eb2356435f9b57393e70bdf615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Creating volume 5020eecf-0b02-418a-a9c7-f0b393f438dc {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:26:43 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:26:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5020eecf-0b02-418a-a9c7-f0b393f438dc 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:43 devstack sudo[88943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5020eecf-0b02-418a-a9c7-f0b393f438dc 1073741824
Apr 14 01:26:43 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:44 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5020eecf-0b02-418a-a9c7-f0b393f438dc 1073741824" returned: 0 in 0.480s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5020eecf-0b02-418a-a9c7-f0b393f438dc {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:44 devstack sudo[88948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5020eecf-0b02-418a-a9c7-f0b393f438dc
Apr 14 01:26:44 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:44 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5020eecf-0b02-418a-a9c7-f0b393f438dc" returned: 0 in 0.404s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:44 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:26:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:26:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf70e6c8-18e5-4a75-9df4-461f174ff469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5020eecf-0b02-418a-a9c7-f0b393f438dc', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7573bbe4-7aa8-44e3-a8b8-3513945042c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:44 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Volume volume-5020eecf-0b02-418a-a9c7-f0b393f438dc (5020eecf-0b02-418a-a9c7-f0b393f438dc): created successfully
Apr 14 01:26:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7573bbe4-7aa8-44e3-a8b8-3513945042c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:44 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Flow 'volume_create_manager' (65ec711a-011b-4457-bc79-145f02a2dbf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:26:44 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b1a6b1a9-622c-49dc-9066-4ad846e48d56 tempest-VolumesGetTest-1868889891 None] Created volume successfully.
Apr 14 01:26:45 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:26:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Flow 'volume_create_manager' (70cfe0b8-c18a-42cf-bf30-1da0fdd27760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:26:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676e5cae-837f-4567-9731-ed3ef2f54863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676e5cae-837f-4567-9731-ed3ef2f54863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:26:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1720672964',display_name='tempest-VolumesGetTest-Volume-2080933948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ed0f9a-ed27-4d60-bdfa-536fbe470880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f678773e3bd84846a31ac4fb87f85a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:26:46Z,use_quota=True,user_id='c86cb4eb2356435f9b57393e70bdf615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcddaeb-3876-4bb8-9aaf-cd543935d262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcddaeb-3876-4bb8-9aaf-cd543935d262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e146edbf-98ec-4702-8954-80c8bf08e8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e146edbf-98ec-4702-8954-80c8bf08e8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ed0f9a-ed27-4d60-bdfa-536fbe470880', 'volume_name': 'volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7c83aa-0252-45d8-988b-a9bd95582afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7c83aa-0252-45d8-988b-a9bd95582afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e5f405-7e69-474e-887e-3ed52461086c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:46 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Volume 92ed0f9a-ed27-4d60-bdfa-536fbe470880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880', 'volume_size': 1}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:26:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1720672964',display_name='tempest-VolumesGetTest-Volume-2080933948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ed0f9a-ed27-4d60-bdfa-536fbe470880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f678773e3bd84846a31ac4fb87f85a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:26:46Z,use_quota=True,user_id='c86cb4eb2356435f9b57393e70bdf615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Creating volume 92ed0f9a-ed27-4d60-bdfa-536fbe470880 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:26:46 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:46 devstack sudo[88951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880 1073741824
Apr 14 01:26:46 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:46 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880 1073741824" returned: 0 in 0.479s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:46 devstack sudo[88956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880
Apr 14 01:26:46 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:46 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880" returned: 0 in 0.414s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e5f405-7e69-474e-887e-3ed52461086c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce2732e-132a-491f-9021-b543e9d8f3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:46 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Volume volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880 (92ed0f9a-ed27-4d60-bdfa-536fbe470880): created successfully
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce2732e-132a-491f-9021-b543e9d8f3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Flow 'volume_create_manager' (70cfe0b8-c18a-42cf-bf30-1da0fdd27760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:26:46 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d68dfe47-e265-4690-b0ed-41d251e7f784 tempest-VolumesGetTest-1868889891 None] Created volume successfully.
Apr 14 01:26:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-92ed0f9a-ed27-4d60-bdfa-536fbe470880-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:26:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Lock "cinder-92ed0f9a-ed27-4d60-bdfa-536fbe470880-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:26:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-quobyte-92ed0f9a-ed27-4d60-bdfa-536fbe470880" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:26:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-92ed0f9a-ed27-4d60-bdfa-536fbe470880" acquired by "delete_volume" :: waited 0.013s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:26:48 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b9f69a-1708-4531-856f-287bd4b478f2]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:48 devstack sudo[88960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880
Apr 14 01:26:48 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:48 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880" returned: 0 in 0.455s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:48 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880
Apr 14 01:26:48 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:49 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-92ed0f9a-ed27-4d60-bdfa-536fbe470880" returned: 0 in 0.395s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-92ed0f9a-ed27-4d60-bdfa-536fbe470880" released by "delete_volume" :: held 0.871s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Created reservations ['35f0402b-339a-496b-b82b-f98de5ce9d7a', 'e48066e7-8347-4938-8cc2-1503d36163cb', '38a3cbc2-ea49-4bae-b368-3511931d5626', '9c92fb2d-9fd6-46ef-accb-b738f493ea7d'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:49 devstack sudo[88968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:26:49 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-5020eecf-0b02-418a-a9c7-f0b393f438dc-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Lock "cinder-5020eecf-0b02-418a-a9c7-f0b393f438dc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-quobyte-5020eecf-0b02-418a-a9c7-f0b393f438dc" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-5020eecf-0b02-418a-a9c7-f0b393f438dc" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7332ba-39ec-46bf-a8ae-8865ba1397d7]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5020eecf-0b02-418a-a9c7-f0b393f438dc {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:49 devstack sudo[88970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5020eecf-0b02-418a-a9c7-f0b393f438dc
Apr 14 01:26:49 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:49 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.406s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:26:49 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Deleted volume successfully.
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5ec254d5-f7ab-47b2-b0cf-288cea8e952f tempest-VolumesGetTest-1868889891 None] Lock "cinder-92ed0f9a-ed27-4d60-bdfa-536fbe470880-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:26:49 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5020eecf-0b02-418a-a9c7-f0b393f438dc" returned: 0 in 0.480s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5020eecf-0b02-418a-a9c7-f0b393f438dc {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:49 devstack sudo[88976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5020eecf-0b02-418a-a9c7-f0b393f438dc
Apr 14 01:26:49 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:50 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5020eecf-0b02-418a-a9c7-f0b393f438dc" returned: 0 in 0.413s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-5020eecf-0b02-418a-a9c7-f0b393f438dc" released by "delete_volume" :: held 0.912s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Created reservations ['280ae8f9-7259-48b1-b568-7cc89ec0c612', '8755e76c-7297-4325-ad19-647071c55a41', '5b22ddcd-1e36-4ced-9726-f0f0ff804fe0', 'aab2cb31-6a38-46de-898e-6654f493156b'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:50 devstack sudo[88979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:26:50 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Flow 'volume_create_manager' (41b92ebf-bd55-4478-8346-1bc163015d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7430a73d-a05e-4b4e-807a-05746f627ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7430a73d-a05e-4b4e-807a-05746f627ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1346759628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9957edf-7490-4b6b-9539-540d0948d86b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f678773e3bd84846a31ac4fb87f85a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:26:51Z,use_quota=True,user_id='c86cb4eb2356435f9b57393e70bdf615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcabed4a-362e-4371-9fa7-bff209644745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcabed4a-362e-4371-9fa7-bff209644745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded9e241-1379-44e2-96d5-95e381f2999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded9e241-1379-44e2-96d5-95e381f2999c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9957edf-7490-4b6b-9539-540d0948d86b', 'volume_name': 'volume-f9957edf-7490-4b6b-9539-540d0948d86b', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8f5145-ef6c-4524-aa03-ab63be17676f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8f5145-ef6c-4524-aa03-ab63be17676f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba42e8a0-4b56-4927-a15b-13941bea51fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:50 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Volume f9957edf-7490-4b6b-9539-540d0948d86b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9957edf-7490-4b6b-9539-540d0948d86b', 'volume_size': 1}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1346759628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9957edf-7490-4b6b-9539-540d0948d86b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f678773e3bd84846a31ac4fb87f85a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:26:51Z,use_quota=True,user_id='c86cb4eb2356435f9b57393e70bdf615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Creating volume f9957edf-7490-4b6b-9539-540d0948d86b {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:26:50 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:50 devstack sudo[88982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b 1073741824
Apr 14 01:26:50 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:50 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.435s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:26:50 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Deleted volume successfully.
Apr 14 01:26:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b52b76ec-26d1-4196-90a8-877812ac102c tempest-VolumesGetTest-1868889891 None] Lock "cinder-5020eecf-0b02-418a-a9c7-f0b393f438dc-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:26:51 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b 1073741824" returned: 0 in 0.471s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:51 devstack sudo[88987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b
Apr 14 01:26:51 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:51 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b" returned: 0 in 0.440s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:26:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:26:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba42e8a0-4b56-4927-a15b-13941bea51fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9957edf-7490-4b6b-9539-540d0948d86b', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e2143d-5ad6-4c5d-a157-9c8c7573a6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:51 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Volume volume-f9957edf-7490-4b6b-9539-540d0948d86b (f9957edf-7490-4b6b-9539-540d0948d86b): created successfully
Apr 14 01:26:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e2143d-5ad6-4c5d-a157-9c8c7573a6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Flow 'volume_create_manager' (41b92ebf-bd55-4478-8346-1bc163015d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:26:51 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-0b845567-e46e-4c33-bf4b-a48a268b074e tempest-VolumesGetTest-1868889891 None] Created volume successfully.
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Flow 'volume_create_manager' (2d540dc0-e4ec-4eba-a5b5-ae4f49c8c2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d28c1b-9a84-42cc-a5a5-46808a0e9330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d28c1b-9a84-42cc-a5a5-46808a0e9330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2058590218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5fa92f-6a5f-4e53-8b4e-18c79b3e8090,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f678773e3bd84846a31ac4fb87f85a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f9957edf-7490-4b6b-9539-540d0948d86b,status='creating',terminated_at=None,updated_at=2026-04-13T23:26:53Z,use_quota=True,user_id='c86cb4eb2356435f9b57393e70bdf615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b7f009-8954-41a3-883c-ae207982f8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b7f009-8954-41a3-883c-ae207982f8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4787b5fe-71d7-4cfc-99ff-47af4d696e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4787b5fe-71d7-4cfc-99ff-47af4d696e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'af5fa92f-6a5f-4e53-8b4e-18c79b3e8090', 'volume_name': 'volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090', 'volume_size': 1, 'source_volid': 'f9957edf-7490-4b6b-9539-540d0948d86b', 'source_volstatus': 'available'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb29392-a090-4ea5-a686-024817c8fba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb29392-a090-4ea5-a686-024817c8fba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd296bd6-e669-4021-802f-0c01f517e50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:26:53 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Volume af5fa92f-6a5f-4e53-8b4e-18c79b3e8090: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090', 'volume_size': 1, 'source_volid': 'f9957edf-7490-4b6b-9539-540d0948d86b', 'source_volstatus': 'available'}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:53 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Cloning volume f9957edf-7490-4b6b-9539-540d0948d86b to volume af5fa92f-6a5f-4e53-8b4e-18c79b3e8090
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Creating offline snapshot ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0 of volume f9957edf-7490-4b6b-9539-540d0948d86b {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[df610a8e-190f-4d76-92cc-193280e5c3d9]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:53 devstack sudo[88990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b
Apr 14 01:26:53 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:53 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b" returned: 0 in 0.464s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:53 devstack sudo[88995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0 1G
Apr 14 01:26:53 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:54 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0 1G" returned: 0 in 0.467s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9957edf-7490-4b6b-9539-540d0948d86b -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:54 devstack sudo[89000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9957edf-7490-4b6b-9539-540d0948d86b -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0
Apr 14 01:26:54 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:54 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9957edf-7490-4b6b-9539-540d0948d86b -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0" returned: 0 in 0.421s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:54 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0 is being set with open permissions: ugo+rw
Apr 14 01:26:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:54 devstack sudo[89005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0
Apr 14 01:26:54 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:54 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0" returned: 0 in 0.399s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:54 devstack sudo[89008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.info
Apr 14 01:26:54 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:55 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.info" returned: 0 in 0.418s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:55 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.info is being set with open permissions: ugo+rw
Apr 14 01:26:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:55 devstack sudo[89011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.info
Apr 14 01:26:55 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:55 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.info" returned: 0 in 0.404s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-quobyte-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090" by "_copy_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:26:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:26:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] snapshot: ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0, volume: af5fa92f-6a5f-4e53-8b4e-18c79b3e8090,  {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 14 01:26:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:26:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:26:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:26:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:26:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:26:55 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3008c44b-c563-4d0a-8335-e5caf3d0efb5]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:55 devstack sudo[89014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0
Apr 14 01:26:55 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:56 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0" returned: 0 in 0.464s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9957edf-7490-4b6b-9539-540d0948d86b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:26:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 14 01:26:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Creating direct copy from snapshot {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 14 01:26:56 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b46947-54bf-40b8-9f2e-1ac4dd44cfaf]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:56 devstack sudo[89019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b
Apr 14 01:26:56 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:56 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b" returned: 0 in 0.462s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:56 devstack cinder-volume[81812]: DEBUG cinder.utils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Path /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090 not found in is_blk_device check {{(pid=81812) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 14 01:26:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:56 devstack sudo[89024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090
Apr 14 01:26:56 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:58 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090" returned: 0 in 1.987s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:58 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13f9830-b0a0-44bd-a9ff-c393f33d59ab]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:58 devstack sudo[89037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b
Apr 14 01:26:58 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:59 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b" returned: 0 in 0.597s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:59 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b, size 1024.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090 {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:26:59 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Converted 1024.00 MB image at 514.93 MB/s
Apr 14 01:26:59 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090 is being set with open permissions: ugo+rw
Apr 14 01:26:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:59 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090
Apr 14 01:26:59 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:26:59 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Apr 14 01:26:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090" returned: 0 in 0.421s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:26:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090" released by "_copy_volume_from_snapshot" :: held 3.973s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:26:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-quobyte-ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:26:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:26:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Deleting offline snapshot ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0 of volume f9957edf-7490-4b6b-9539-540d0948d86b {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:26:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] snapshot_file for this snap is: volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:26:59 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e86a87-05ba-4fb8-8169-43b6b3c19232]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:26:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:26:59 devstack sudo[89045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0
Apr 14 01:26:59 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:00 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0" returned: 0 in 0.491s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9957edf-7490-4b6b-9539-540d0948d86b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:27:00 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd7be48-f855-4163-8d50-31ad9f6e050e]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:27:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:00 devstack sudo[89051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b
Apr 14 01:27:00 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:00 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b" returned: 0 in 0.486s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:00 devstack sudo[89056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0
Apr 14 01:27:00 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:01 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0" returned: 0 in 0.451s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:01 devstack sudo[89061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0
Apr 14 01:27:01 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:01 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b.ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0" returned: 0 in 0.431s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-ecf6ac8e-da1f-4e1f-aec5-92ac779b3ae0" released by "_delete_snapshot" :: held 1.904s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:27:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.556s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd296bd6-e669-4021-802f-0c01f517e50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090', 'volume_size': 1, 'source_volid': 'f9957edf-7490-4b6b-9539-540d0948d86b', 'source_volstatus': 'available'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce81843-2ef3-4e77-94e7-b7bf8af9f549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:01 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Volume volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090 (af5fa92f-6a5f-4e53-8b4e-18c79b3e8090): created successfully
Apr 14 01:27:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce81843-2ef3-4e77-94e7-b7bf8af9f549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Flow 'volume_create_manager' (2d540dc0-e4ec-4eba-a5b5-ae4f49c8c2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:01 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-cdec659a-9701-45fd-9347-20ce8f3d8e5a tempest-VolumesGetTest-1868889891 None] Created volume successfully.
Apr 14 01:27:02 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Flow 'volume_create_manager' (93668b4b-617c-44f9-af21-b3aa7bd76e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a17863-5b4a-48ee-a71e-cd4234a01073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a17863-5b4a-48ee-a71e-cd4234a01073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-773745774',display_name='tempest-VolumesGetTest-Volume-1901154882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75453a16-78ef-4236-af6f-e4af6b6c53a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f678773e3bd84846a31ac4fb87f85a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:03Z,use_quota=True,user_id='c86cb4eb2356435f9b57393e70bdf615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933badde-34bb-4aeb-95ef-4d7b5aa0d50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933badde-34bb-4aeb-95ef-4d7b5aa0d50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8582c6-c4dc-4b1a-b600-422974aa99b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8582c6-c4dc-4b1a-b600-422974aa99b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75453a16-78ef-4236-af6f-e4af6b6c53a2', 'volume_name': 'volume-75453a16-78ef-4236-af6f-e4af6b6c53a2', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d23b4ed-3e66-488d-936e-9b3b5af46804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d23b4ed-3e66-488d-936e-9b3b5af46804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7fd30c-d061-4762-9c20-d8a2bf71fa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:03 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Volume 75453a16-78ef-4236-af6f-e4af6b6c53a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75453a16-78ef-4236-af6f-e4af6b6c53a2', 'volume_size': 1}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-773745774',display_name='tempest-VolumesGetTest-Volume-1901154882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75453a16-78ef-4236-af6f-e4af6b6c53a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f678773e3bd84846a31ac4fb87f85a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:03Z,use_quota=True,user_id='c86cb4eb2356435f9b57393e70bdf615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Creating volume 75453a16-78ef-4236-af6f-e4af6b6c53a2 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:27:03 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-75453a16-78ef-4236-af6f-e4af6b6c53a2 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:03 devstack sudo[89064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-75453a16-78ef-4236-af6f-e4af6b6c53a2 1073741824
Apr 14 01:27:03 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:03 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-75453a16-78ef-4236-af6f-e4af6b6c53a2 1073741824" returned: 0 in 0.471s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-75453a16-78ef-4236-af6f-e4af6b6c53a2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:03 devstack sudo[89069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-75453a16-78ef-4236-af6f-e4af6b6c53a2
Apr 14 01:27:03 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:03 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_service.periodic_task [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81812) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-75453a16-78ef-4236-af6f-e4af6b6c53a2" returned: 0 in 0.430s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:03 devstack sudo[89072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:27:03 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7fd30c-d061-4762-9c20-d8a2bf71fa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75453a16-78ef-4236-af6f-e4af6b6c53a2', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95bd1dd-6850-45a5-a1a9-c8adcda140a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:04 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Volume volume-75453a16-78ef-4236-af6f-e4af6b6c53a2 (75453a16-78ef-4236-af6f-e4af6b6c53a2): created successfully
Apr 14 01:27:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95bd1dd-6850-45a5-a1a9-c8adcda140a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:04 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Flow 'volume_create_manager' (93668b4b-617c-44f9-af21-b3aa7bd76e96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:04 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-4707b2e7-85a0-46d0-b669-e5aafd8d417d tempest-VolumesGetTest-1868889891 None] Created volume successfully.
Apr 14 01:27:04 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.424s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:04 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:27:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-75453a16-78ef-4236-af6f-e4af6b6c53a2-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:27:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Lock "cinder-75453a16-78ef-4236-af6f-e4af6b6c53a2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:27:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-quobyte-75453a16-78ef-4236-af6f-e4af6b6c53a2" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:27:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-75453a16-78ef-4236-af6f-e4af6b6c53a2" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:27:05 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[547e7048-ad4e-4782-870f-f446e7334700]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:27:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-75453a16-78ef-4236-af6f-e4af6b6c53a2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:05 devstack sudo[89081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-75453a16-78ef-4236-af6f-e4af6b6c53a2
Apr 14 01:27:05 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:05 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-75453a16-78ef-4236-af6f-e4af6b6c53a2" returned: 0 in 0.467s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-75453a16-78ef-4236-af6f-e4af6b6c53a2 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:05 devstack sudo[89086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-75453a16-78ef-4236-af6f-e4af6b6c53a2
Apr 14 01:27:05 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:06 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-75453a16-78ef-4236-af6f-e4af6b6c53a2" returned: 0 in 0.417s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-75453a16-78ef-4236-af6f-e4af6b6c53a2" released by "delete_volume" :: held 0.912s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Created reservations ['24d3f964-e0fe-4036-a7af-cb54cd3e1375', '98c87b40-dbca-4ec3-a418-e8b14b6dee1f', '3c713b28-bc88-4de7-bdea-e84f776a6097', '4d494f45-62b6-47a5-aca0-180be0239625'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:06 devstack sudo[89089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:27:06 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Lock "cinder-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-quobyte-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5431c968-ad1e-40ae-9245-bbaf52024e27]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:06 devstack sudo[89091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090
Apr 14 01:27:06 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:06 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.428s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:27:06 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Deleted volume successfully.
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-12fb4499-767a-4533-8648-06a7a12ee2af tempest-VolumesGetTest-1868889891 None] Lock "cinder-75453a16-78ef-4236-af6f-e4af6b6c53a2-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:27:06 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090" returned: 0 in 0.476s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:06 devstack sudo[89097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090
Apr 14 01:27:06 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:07 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090" returned: 0 in 0.414s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090" released by "delete_volume" :: held 0.918s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Created reservations ['6e575280-0bba-42b2-952f-db24e309a379', 'e9a1a117-96f4-447b-8669-20406ac08213', '9400438e-0382-4369-8b37-239f15e04fe2', '310be0d6-0499-4390-bd89-67574ff7524c'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:07 devstack sudo[89101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:27:07 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-f9957edf-7490-4b6b-9539-540d0948d86b-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Lock "cinder-f9957edf-7490-4b6b-9539-540d0948d86b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-quobyte-f9957edf-7490-4b6b-9539-540d0948d86b" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-f9957edf-7490-4b6b-9539-540d0948d86b" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ff417b-e0de-405f-a7ff-eee7a9064bec]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:07 devstack sudo[89103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b
Apr 14 01:27:07 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:07 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.424s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:27:07 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Deleted volume successfully.
Apr 14 01:27:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c00bf72d-bda6-4fe6-8aa6-8b07d4ba1f2d tempest-VolumesGetTest-1868889891 None] Lock "cinder-af5fa92f-6a5f-4e53-8b4e-18c79b3e8090-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:27:08 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b" returned: 0 in 0.473s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:08 devstack sudo[89109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b
Apr 14 01:27:08 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:08 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9957edf-7490-4b6b-9539-540d0948d86b" returned: 0 in 0.412s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-f9957edf-7490-4b6b-9539-540d0948d86b" released by "delete_volume" :: held 0.922s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:27:08 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Created reservations ['6e971608-1c14-4618-89ca-41a66a81af11', 'c5f9faa7-84b3-461b-baef-05f1e6c8b254', '155cc6e6-2fa6-49ed-8b53-614426627a3f', 'f85915a2-9525-409a-8aa5-e98c34d96f10'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:27:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:27:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:27:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:08 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:27:08 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:09 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.444s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:27:09 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Deleted volume successfully.
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Flow 'volume_create_manager' (d4cc19b1-6ec1-42c8-9571-9d1e4a116912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd6a1a6-431b-4586-a07d-c392936ffdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd6a1a6-431b-4586-a07d-c392936ffdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-121178402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fdff22f-4ffb-464b-8301-9fd78a7b2248,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f678773e3bd84846a31ac4fb87f85a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:09Z,use_quota=True,user_id='c86cb4eb2356435f9b57393e70bdf615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d2ad91-134a-4e73-88dd-15d3a0dd33e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d2ad91-134a-4e73-88dd-15d3a0dd33e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa18a34-0327-4e49-9893-df22d6c839b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.image.glance [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Creating Keystone auth plugin from conf {{(pid=81812) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-f6d4bb3c-9603-4b8a-af01-fbe42d35a9d3 tempest-VolumesGetTest-1868889891 None] Lock "cinder-f9957edf-7490-4b6b-9539-540d0948d86b-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa18a34-0327-4e49-9893-df22d6c839b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6fdff22f-4ffb-464b-8301-9fd78a7b2248', 'volume_name': 'volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248', 'volume_size': 1, 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '632509b247064588826fa463262eaec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'created_at': datetime.datetime(2026, 4, 13, 23, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 23, 14, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f70df22e2f0>}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45b9367-57fd-4edd-a578-52565aff3cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45b9367-57fd-4edd-a578-52565aff3cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d1660c-c155-4778-908e-e385c3c301d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:09 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Volume 6fdff22f-4ffb-464b-8301-9fd78a7b2248: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248', 'volume_size': 1, 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '632509b247064588826fa463262eaec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'created_at': datetime.datetime(2026, 4, 13, 23, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 23, 14, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f70df22e2f0>}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Trying to clone 6fdff22f-4ffb-464b-8301-9fd78a7b2248 from image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c at location (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]). {{(pid=81812) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_fxwz15nsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81812) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 14 01:27:09 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Image download 20.69 MB at 20.69 MB/s
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88e308b-da63-4d00-bec5-351a056253b2]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_fxwz15nsdevstack@QuobyteHD {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:09 devstack sudo[89117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_fxwz15nsdevstack@QuobyteHD
Apr 14 01:27:09 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:09 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_fxwz15nsdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Temporary image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c is fetched for user c86cb4eb2356435f9b57393e70bdf615. {{(pid=81812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f226b8b2-15f4-4464-9d70-2a2492270de2]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:27:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_fxwz15nsdevstack@QuobyteHD {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:10 devstack sudo[89122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_fxwz15nsdevstack@QuobyteHD
Apr 14 01:27:10 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:10 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_fxwz15nsdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-121178402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fdff22f-4ffb-464b-8301-9fd78a7b2248,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f678773e3bd84846a31ac4fb87f85a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:09Z,use_quota=True,user_id='c86cb4eb2356435f9b57393e70bdf615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:27:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Creating volume 6fdff22f-4ffb-464b-8301-9fd78a7b2248 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:27:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:27:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:27:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:27:10 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:27:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:10 devstack sudo[89127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 1073741824
Apr 14 01:27:10 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:10 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 1073741824" returned: 0 in 0.507s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:10 devstack sudo[89132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248
Apr 14 01:27:10 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:11 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248" returned: 0 in 0.412s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:27:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:11 devstack cinder-volume[81812]: DEBUG cinder.volume.volume_utils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Attempting download of e868e97b-1f2a-4ab6-b767-6d5c40d5e10c ((None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}])) to volume 6fdff22f-4ffb-464b-8301-9fd78a7b2248. {{(pid=81812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 14 01:27:11 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e26b18-dd0a-4e86-ab8b-aafebcf59c1c]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:27:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_zo93zud_ {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:11 devstack sudo[89135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_zo93zud_
Apr 14 01:27:11 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:11 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_zo93zud_" returned: 0 in 0.472s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_zo93zud_ {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:11 devstack sudo[89139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_zo93zud_
Apr 14 01:27:11 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:12 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_zo93zud_" returned: 1 in 0.463s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_zo93zud_' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:27:12 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd59054-9dc7-49a0-83dc-873ec2b413f6]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:27:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_fxwz15nsdevstack@QuobyteHD {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:12 devstack sudo[89143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_fxwz15nsdevstack@QuobyteHD
Apr 14 01:27:12 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:12 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_fxwz15nsdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:12 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] e868e97b-1f2a-4ab6-b767-6d5c40d5e10c was qcow2, converting to raw {{(pid=81812) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 14 01:27:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_fxwz15nsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:12 devstack sudo[89148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_fxwz15nsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248
Apr 14 01:27:12 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:13 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_fxwz15nsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248" returned: 0 in 0.810s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:13 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e868e97b-1f2a-4ab6-b767-6d5c40d5e10c_fxwz15nsdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:27:13 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Converted 112.00 MB image at 112.00 MB/s
Apr 14 01:27:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:13 devstack sudo[89162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 1G
Apr 14 01:27:13 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:14 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 1G" returned: 0 in 0.423s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:14 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[15626aa5-5d88-4303-8bf1-66bb0385130a]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:27:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:14 devstack sudo[89167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248
Apr 14 01:27:14 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:14 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248" returned: 0 in 0.458s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:14 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248
Apr 14 01:27:14 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:14 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248" returned: 1 in 0.455s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.volume_utils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Downloaded image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c ((None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}])) to volume 6fdff22f-4ffb-464b-8301-9fd78a7b2248 successfully. {{(pid=81812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Temporary image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c for user c86cb4eb2356435f9b57393e70bdf615 is deleted. {{(pid=81812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.volume_utils [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Marking volume 6fdff22f-4ffb-464b-8301-9fd78a7b2248 as bootable. {{(pid=81812) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Copying metadata from image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c to 6fdff22f-4ffb-464b-8301-9fd78a7b2248. {{(pid=81812) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Creating volume glance metadata for volume 6fdff22f-4ffb-464b-8301-9fd78a7b2248 backed by image e868e97b-1f2a-4ab6-b767-6d5c40d5e10c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81812) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d1660c-c155-4778-908e-e385c3c301d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248', 'volume_size': 1, 'image_id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '632509b247064588826fa463262eaec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e868e97b-1f2a-4ab6-b767-6d5c40d5e10c', 'created_at': datetime.datetime(2026, 4, 13, 23, 14, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 23, 14, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e868e97b-1f2a-4ab6-b767-6d5c40d5e10c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f70df22e2f0>}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8d3d85-863e-4bfc-b6ef-b9d8fdb38594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:15 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Volume volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 (6fdff22f-4ffb-464b-8301-9fd78a7b2248): created successfully
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8d3d85-863e-4bfc-b6ef-b9d8fdb38594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Flow 'volume_create_manager' (d4cc19b1-6ec1-42c8-9571-9d1e4a116912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:15 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-93fb9490-d829-46d0-86ed-6bb1c5562e8a tempest-VolumesGetTest-1868889891 None] Created volume successfully.
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Flow 'volume_create_manager' (e2d74629-3f1a-4cd1-aaab-1594270113ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48f4e28-5fc6-4886-8c5c-c2366b2707c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48f4e28-5fc6-4886-8c5c-c2366b2707c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1645321173',display_name='tempest-VolumesGetTest-Volume-1116550090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d70baf-ae1e-49c8-90a7-6cf6c07148ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f678773e3bd84846a31ac4fb87f85a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:16Z,use_quota=True,user_id='c86cb4eb2356435f9b57393e70bdf615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65fa86bb-4d3e-46e6-9fbd-6be5684bf730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65fa86bb-4d3e-46e6-9fbd-6be5684bf730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318c1c59-d2e3-48bc-a4bd-ee0a002f58a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318c1c59-d2e3-48bc-a4bd-ee0a002f58a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16d70baf-ae1e-49c8-90a7-6cf6c07148ee', 'volume_name': 'volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77849f0-c3a0-4234-bd39-8d2883b8c0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77849f0-c3a0-4234-bd39-8d2883b8c0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a052b3e4-5aa8-48ef-b471-60a361dd8449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:15 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Volume 16d70baf-ae1e-49c8-90a7-6cf6c07148ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee', 'volume_size': 1}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1645321173',display_name='tempest-VolumesGetTest-Volume-1116550090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d70baf-ae1e-49c8-90a7-6cf6c07148ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f678773e3bd84846a31ac4fb87f85a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:16Z,use_quota=True,user_id='c86cb4eb2356435f9b57393e70bdf615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Creating volume 16d70baf-ae1e-49c8-90a7-6cf6c07148ee {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:27:15 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:27:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:15 devstack sudo[89210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee 1073741824
Apr 14 01:27:15 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:16 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee 1073741824" returned: 0 in 0.462s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:16 devstack sudo[89215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee
Apr 14 01:27:16 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:16 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee" returned: 0 in 0.419s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:16 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:27:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a052b3e4-5aa8-48ef-b471-60a361dd8449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ffd368-de75-4741-a387-f6b2cb740a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:16 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Volume volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee (16d70baf-ae1e-49c8-90a7-6cf6c07148ee): created successfully
Apr 14 01:27:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ffd368-de75-4741-a387-f6b2cb740a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Flow 'volume_create_manager' (e2d74629-3f1a-4cd1-aaab-1594270113ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:16 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-1bb7ef56-6f2b-4a77-81ce-f58714df5f51 tempest-VolumesGetTest-1868889891 None] Created volume successfully.
Apr 14 01:27:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-16d70baf-ae1e-49c8-90a7-6cf6c07148ee-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:27:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Lock "cinder-16d70baf-ae1e-49c8-90a7-6cf6c07148ee-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:27:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-quobyte-16d70baf-ae1e-49c8-90a7-6cf6c07148ee" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:27:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-16d70baf-ae1e-49c8-90a7-6cf6c07148ee" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:27:17 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9a8e58-a11d-4719-a11c-427ebe2e109b]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:27:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:18 devstack sudo[89219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee
Apr 14 01:27:18 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:18 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee" returned: 0 in 0.472s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:18 devstack sudo[89224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee
Apr 14 01:27:18 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:18 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-16d70baf-ae1e-49c8-90a7-6cf6c07148ee" returned: 0 in 0.409s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-16d70baf-ae1e-49c8-90a7-6cf6c07148ee" released by "delete_volume" :: held 0.904s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:27:18 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Created reservations ['9a0d46cd-5065-4a9a-add2-440da91f6d1c', '6392871e-0c29-4b12-957b-1db2592408f5', 'e6c9782e-4577-4f53-b3e0-ad9c1a07ec3d', '68932e39-9d0c-43bd-85d1-f513bacef3ca'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:27:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:27:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:27:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:18 devstack sudo[89227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:27:18 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-6fdff22f-4ffb-464b-8301-9fd78a7b2248-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:27:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Lock "cinder-6fdff22f-4ffb-464b-8301-9fd78a7b2248-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:27:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Acquiring lock "cinder-quobyte-6fdff22f-4ffb-464b-8301-9fd78a7b2248" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:27:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-6fdff22f-4ffb-464b-8301-9fd78a7b2248" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:27:19 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac21b26e-c1e2-4a6a-8251-b56c2ed91301]: (4, 'raw') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:27:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:19 devstack sudo[89229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248
Apr 14 01:27:19 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:19 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.465s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:19 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:27:19 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Deleted volume successfully.
Apr 14 01:27:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a621f3f7-2957-4a5c-97ce-13a1b253ce85 tempest-VolumesGetTest-1868889891 None] Lock "cinder-16d70baf-ae1e-49c8-90a7-6cf6c07148ee-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:27:19 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248" returned: 0 in 0.490s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:19 devstack sudo[89234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248
Apr 14 01:27:19 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:20 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248" returned: 1 in 0.470s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248' failed. Not Retrying. {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 14 01:27:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:20 devstack sudo[89239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248
Apr 14 01:27:20 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:20 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-6fdff22f-4ffb-464b-8301-9fd78a7b2248" returned: 0 in 0.418s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Lock "cinder-quobyte-6fdff22f-4ffb-464b-8301-9fd78a7b2248" released by "delete_volume" :: held 1.431s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:27:20 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:SELECT=67,cinder:UPDATE=75,cinder:INSERT=30,cinder:DELETE=6 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:27:20 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Created reservations ['8c8cc5e9-20dc-4011-9e75-1519f0a11582', '7db8ad0c-c552-4331-901f-cc58b5b63e98', '4cf55e07-3ee7-43f7-bf58-a1bd22a68bfe', 'c1d42ef4-9034-44ac-9d5c-32fbfda95bc5'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:27:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:27:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:27:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:20 devstack sudo[89242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:27:20 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:21 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.425s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:21 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:27:21 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Deleted volume successfully.
Apr 14 01:27:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-4f0daf39-28d8-482d-9e17-675355fea899 tempest-VolumesGetTest-1868889891 None] Lock "cinder-6fdff22f-4ffb-464b-8301-9fd78a7b2248-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Flow 'volume_create_manager' (d5bd6248-d6bb-4894-83ed-8a37ec6e2070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1cf20ee-c995-427e-a5ff-c18a641dc6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1cf20ee-c995-427e-a5ff-c18a641dc6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-41383552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fae3dfb-c773-4089-ab73-15c8ca69c28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5a9bb8b0214452899080ef24baa207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:24Z,use_quota=True,user_id='1f873c172eab40caa3092b6d3b7f9b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ec1c4f-70c1-4b36-babf-7861cfffc241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ec1c4f-70c1-4b36-babf-7861cfffc241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9fdd3a1-b6da-46e8-a7e8-a7506fbe4c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9fdd3a1-b6da-46e8-a7e8-a7506fbe4c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fae3dfb-c773-4089-ab73-15c8ca69c28a', 'volume_name': 'volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc88443-977f-4031-aff5-57ccc5271a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc88443-977f-4031-aff5-57ccc5271a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45f00f2-4afa-4615-8504-dd55b0d28339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:24 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Volume 4fae3dfb-c773-4089-ab73-15c8ca69c28a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a', 'volume_size': 1}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-41383552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fae3dfb-c773-4089-ab73-15c8ca69c28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5a9bb8b0214452899080ef24baa207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:24Z,use_quota=True,user_id='1f873c172eab40caa3092b6d3b7f9b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Creating volume 4fae3dfb-c773-4089-ab73-15c8ca69c28a {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:27:24 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:24 devstack sudo[89245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a 1073741824
Apr 14 01:27:24 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:24 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a 1073741824" returned: 0 in 0.491s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:24 devstack sudo[89250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a
Apr 14 01:27:24 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:25 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a" returned: 0 in 0.397s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:25 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:27:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:25 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45f00f2-4afa-4615-8504-dd55b0d28339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:25 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19e57f0-7b91-4709-adee-d1374f6368c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:25 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Volume volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a (4fae3dfb-c773-4089-ab73-15c8ca69c28a): created successfully
Apr 14 01:27:25 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19e57f0-7b91-4709-adee-d1374f6368c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:25 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Flow 'volume_create_manager' (d5bd6248-d6bb-4894-83ed-8a37ec6e2070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:25 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-915f3522-9ec0-4cb6-9217-a7fefcd4fbaa tempest-VolumesNegativeTest-1083867752 None] Created volume successfully.
Apr 14 01:27:35 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:SELECT=60,cinder:UPDATE=90,cinder:INSERT=23,cinder:DELETE=9 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:27:35 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:UPDATE=9,cinder:SELECT=3,cinder:DELETE=1 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:27:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Acquiring lock "cinder-4fae3dfb-c773-4089-ab73-15c8ca69c28a-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:27:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Lock "cinder-4fae3dfb-c773-4089-ab73-15c8ca69c28a-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:27:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Acquiring lock "cinder-quobyte-4fae3dfb-c773-4089-ab73-15c8ca69c28a" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:27:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Lock "cinder-quobyte-4fae3dfb-c773-4089-ab73-15c8ca69c28a" acquired by "delete_volume" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:27:50 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a29c137-65e3-4de8-89e1-1000827173cb]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:27:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:50 devstack sudo[89336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a
Apr 14 01:27:50 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:50 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a" returned: 0 in 0.474s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:50 devstack sudo[89341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a
Apr 14 01:27:50 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:50 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4fae3dfb-c773-4089-ab73-15c8ca69c28a" returned: 0 in 0.419s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Lock "cinder-quobyte-4fae3dfb-c773-4089-ab73-15c8ca69c28a" released by "delete_volume" :: held 0.927s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:27:51 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Created reservations ['6fd99200-ffdc-43ce-8b14-c842b7e5a979', 'b1ed8397-1f4e-49f0-9fa9-460959a8475d', 'aa9f9776-903f-4323-84d7-e0a88ec41226', '56c68842-5990-4add-87c9-61d89a22ab83'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:27:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:27:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:27:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:51 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:27:51 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:51 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.472s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:51 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:27:51 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Deleted volume successfully.
Apr 14 01:27:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3e654e0c-426a-4b35-a78d-42e18bad0dd0 tempest-VolumesNegativeTest-1083867752 None] Lock "cinder-4fae3dfb-c773-4089-ab73-15c8ca69c28a-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Flow 'volume_create_manager' (f0bf4e4c-1ff3-432c-9685-b382f7bddf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90870b4-7b44-4a1d-9af0-55cf4346f2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90870b4-7b44-4a1d-9af0-55cf4346f2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-845107042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3085c80-357b-43b2-ad54-0834189c76b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b368905e90854f35850955a5ba0cd36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:52Z,use_quota=True,user_id='8600559f966647c3b677a5fe86076040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786b0227-f29b-4727-a0c6-5b69bc23f034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786b0227-f29b-4727-a0c6-5b69bc23f034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6378c1e4-14d0-4b4d-b15d-1c71d6a42a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6378c1e4-14d0-4b4d-b15d-1c71d6a42a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3085c80-357b-43b2-ad54-0834189c76b7', 'volume_name': 'volume-d3085c80-357b-43b2-ad54-0834189c76b7', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab12d0a-1bf8-4956-b26b-99248c4356d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab12d0a-1bf8-4956-b26b-99248c4356d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327283e7-2ff9-417a-87d4-eab774a4dd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:52 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume d3085c80-357b-43b2-ad54-0834189c76b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3085c80-357b-43b2-ad54-0834189c76b7', 'volume_size': 1}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.017s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-845107042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3085c80-357b-43b2-ad54-0834189c76b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b368905e90854f35850955a5ba0cd36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:52Z,use_quota=True,user_id='8600559f966647c3b677a5fe86076040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Creating volume d3085c80-357b-43b2-ad54-0834189c76b7 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:27:52 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:27:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:52 devstack sudo[89347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7 1073741824
Apr 14 01:27:52 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:53 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7 1073741824" returned: 0 in 0.475s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:53 devstack sudo[89352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7
Apr 14 01:27:53 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:53 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7" returned: 0 in 0.411s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:53 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:27:53 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327283e7-2ff9-417a-87d4-eab774a4dd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3085c80-357b-43b2-ad54-0834189c76b7', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3013bde-db4d-4dcd-94ef-5dc3943a2c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:53 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume volume-d3085c80-357b-43b2-ad54-0834189c76b7 (d3085c80-357b-43b2-ad54-0834189c76b7): created successfully
Apr 14 01:27:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3013bde-db4d-4dcd-94ef-5dc3943a2c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:53 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Flow 'volume_create_manager' (f0bf4e4c-1ff3-432c-9685-b382f7bddf13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:53 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-a85bec7b-8f0a-488b-8fc6-afc82feaab90 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Created volume successfully.
Apr 14 01:27:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:54 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Creating offline snapshot 062dfff7-96cb-4323-8562-65f0d9260c2e of volume d3085c80-357b-43b2-ad54-0834189c76b7 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:27:54 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc51af9-446a-42fc-b354-35c288ed5726]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:27:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:54 devstack sudo[89355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7
Apr 14 01:27:54 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:55 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7" returned: 0 in 0.465s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:55 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e 1G
Apr 14 01:27:55 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:55 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e 1G" returned: 0 in 0.455s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3085c80-357b-43b2-ad54-0834189c76b7 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:55 devstack sudo[89365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3085c80-357b-43b2-ad54-0834189c76b7 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e
Apr 14 01:27:55 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:56 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3085c80-357b-43b2-ad54-0834189c76b7 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e" returned: 0 in 0.453s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:56 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e is being set with open permissions: ugo+rw
Apr 14 01:27:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:56 devstack sudo[89370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e
Apr 14 01:27:56 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:56 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e" returned: 0 in 0.410s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:56 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.info
Apr 14 01:27:56 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:56 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.info" returned: 0 in 0.415s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:56 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.info is being set with open permissions: ugo+rw
Apr 14 01:27:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:56 devstack sudo[89376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.info
Apr 14 01:27:56 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:57 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.info" returned: 0 in 0.411s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:57 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c61f087c-8663-43eb-906a-9e253c87f0b9 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Create snapshot completed successfully
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Flow 'volume_create_manager' (82779c48-9582-461e-8485-c4c73178f26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ddb129-788d-4a03-aeaf-c5dc3a93b1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ddb129-788d-4a03-aeaf-c5dc3a93b1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1111898664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f321c043-4503-4654-a129-3aee2c454e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b368905e90854f35850955a5ba0cd36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:58Z,use_quota=True,user_id='8600559f966647c3b677a5fe86076040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d10be8-4540-4bee-b69e-9b1cabbc1fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d10be8-4540-4bee-b69e-9b1cabbc1fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d3cc46-9105-4a5d-89f9-48a187c7f55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d3cc46-9105-4a5d-89f9-48a187c7f55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f321c043-4503-4654-a129-3aee2c454e34', 'volume_name': 'volume-f321c043-4503-4654-a129-3aee2c454e34', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8706f31d-440e-41a5-b4fe-31d8f123716d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8706f31d-440e-41a5-b4fe-31d8f123716d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767bba27-f371-4abc-a41c-00e7c8672138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume f321c043-4503-4654-a129-3aee2c454e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f321c043-4503-4654-a129-3aee2c454e34', 'volume_size': 1}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1111898664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f321c043-4503-4654-a129-3aee2c454e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b368905e90854f35850955a5ba0cd36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:58Z,use_quota=True,user_id='8600559f966647c3b677a5fe86076040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Creating volume f321c043-4503-4654-a129-3aee2c454e34 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:27:58 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f321c043-4503-4654-a129-3aee2c454e34 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:58 devstack sudo[89380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f321c043-4503-4654-a129-3aee2c454e34 1073741824
Apr 14 01:27:58 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Flow 'volume_create_manager' (328d7bba-a260-4061-a1dd-73d52b09e47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5cd214-14e0-4ba9-ab8a-44d4ae38742e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5cd214-14e0-4ba9-ab8a-44d4ae38742e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1217282825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8800c052-a8d7-4a04-81fe-67dd6b64cbde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b368905e90854f35850955a5ba0cd36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:58Z,use_quota=True,user_id='8600559f966647c3b677a5fe86076040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c19db9f-6f58-4d6c-829f-e16abecf3362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c19db9f-6f58-4d6c-829f-e16abecf3362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57160ee6-458d-4fd4-9730-81df55d81056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57160ee6-458d-4fd4-9730-81df55d81056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8800c052-a8d7-4a04-81fe-67dd6b64cbde', 'volume_name': 'volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8d550f-af1a-42e8-9aaa-a46b97bcde49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8d550f-af1a-42e8-9aaa-a46b97bcde49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c589ff2d-d275-439a-9cd4-39455d590e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume 8800c052-a8d7-4a04-81fe-67dd6b64cbde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde', 'volume_size': 1}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Flow 'volume_create_manager' (8025d5b7-7aa5-4476-a9fb-3f9c50cd5248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c93014-6a8d-4389-94fc-e5b8e5488328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c93014-6a8d-4389-94fc-e5b8e5488328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2043200627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a61e103-b238-434b-8bd0-bc4770770c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b368905e90854f35850955a5ba0cd36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:58Z,use_quota=True,user_id='8600559f966647c3b677a5fe86076040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f569eb2-09bd-44ae-a435-101ce12f4a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f569eb2-09bd-44ae-a435-101ce12f4a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d206ac-4128-49a0-958e-faa8bea91d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d206ac-4128-49a0-958e-faa8bea91d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a61e103-b238-434b-8bd0-bc4770770c39', 'volume_name': 'volume-8a61e103-b238-434b-8bd0-bc4770770c39', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740fb5fc-eb8d-4d31-b21c-16038cae2a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740fb5fc-eb8d-4d31-b21c-16038cae2a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce0cb78-1b9c-4bdf-a3d1-e0b5e1941216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume 8a61e103-b238-434b-8bd0-bc4770770c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a61e103-b238-434b-8bd0-bc4770770c39', 'volume_size': 1}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Flow 'volume_create_manager' (00852961-0374-43d5-9394-39a5585606c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd13d63-0938-42b7-bdca-1e094b587568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd13d63-0938-42b7-bdca-1e094b587568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-413459347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f171b43-7d13-44b8-81c5-be334bf14796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b368905e90854f35850955a5ba0cd36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:59Z,use_quota=True,user_id='8600559f966647c3b677a5fe86076040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235f4c4d-0307-4304-bce9-030a4595fde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235f4c4d-0307-4304-bce9-030a4595fde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e20febd-b0f9-4693-9738-c7654f6bfa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e20febd-b0f9-4693-9738-c7654f6bfa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f171b43-7d13-44b8-81c5-be334bf14796', 'volume_name': 'volume-8f171b43-7d13-44b8-81c5-be334bf14796', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b0c26b-3231-4f16-8dc8-00850968a995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b0c26b-3231-4f16-8dc8-00850968a995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d816194-b548-490a-97e0-dd9bba7c3d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume 8f171b43-7d13-44b8-81c5-be334bf14796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f171b43-7d13-44b8-81c5-be334bf14796', 'volume_size': 1}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:58 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f321c043-4503-4654-a129-3aee2c454e34 1073741824" returned: 0 in 0.622s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Flow 'volume_create_manager' (5c908648-080e-43fb-ba6a-aab6e8b29ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c694ba0-ef6d-44d4-8b30-5a7fd7b82887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f321c043-4503-4654-a129-3aee2c454e34 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c694ba0-ef6d-44d4-8b30-5a7fd7b82887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-867490531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada11bb7-d747-45a8-bea1-54d90988c2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b368905e90854f35850955a5ba0cd36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:59Z,use_quota=True,user_id='8600559f966647c3b677a5fe86076040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abd4a15-8490-437e-a63d-1dbeffcaa17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack sudo[89385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f321c043-4503-4654-a129-3aee2c454e34
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abd4a15-8490-437e-a63d-1dbeffcaa17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5c8218-82ec-4e7b-926b-baa3a9ce9e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5c8218-82ec-4e7b-926b-baa3a9ce9e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada11bb7-d747-45a8-bea1-54d90988c2a1', 'volume_name': 'volume-ada11bb7-d747-45a8-bea1-54d90988c2a1', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8a7c13-38b3-4e92-a87f-0a7c2c0ad78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8a7c13-38b3-4e92-a87f-0a7c2c0ad78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cffe81-57d9-4a5c-bd8c-e2c6781bb012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:58 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume ada11bb7-d747-45a8-bea1-54d90988c2a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada11bb7-d747-45a8-bea1-54d90988c2a1', 'volume_size': 1}
Apr 14 01:27:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:59 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f321c043-4503-4654-a129-3aee2c454e34" returned: 0 in 0.412s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.898s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1217282825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8800c052-a8d7-4a04-81fe-67dd6b64cbde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b368905e90854f35850955a5ba0cd36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:58Z,use_quota=True,user_id='8600559f966647c3b677a5fe86076040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Creating volume 8800c052-a8d7-4a04-81fe-67dd6b64cbde {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:27:59 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767bba27-f371-4abc-a41c-00e7c8672138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f321c043-4503-4654-a129-3aee2c454e34', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:59 devstack sudo[89388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde 1073741824
Apr 14 01:27:59 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8b6051-70eb-4597-adfc-bd3a30d5616e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:27:59 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume volume-f321c043-4503-4654-a129-3aee2c454e34 (f321c043-4503-4654-a129-3aee2c454e34): created successfully
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8b6051-70eb-4597-adfc-bd3a30d5616e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Flow 'volume_create_manager' (82779c48-9582-461e-8485-c4c73178f26a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:27:59 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5be01881-0b41-41bc-a109-bb15297c69e1 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Created volume successfully.
Apr 14 01:27:59 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde 1073741824" returned: 0 in 0.490s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:27:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:27:59 devstack sudo[89393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde
Apr 14 01:27:59 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:00 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde" returned: 0 in 0.417s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.671s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2043200627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a61e103-b238-434b-8bd0-bc4770770c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b368905e90854f35850955a5ba0cd36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:58Z,use_quota=True,user_id='8600559f966647c3b677a5fe86076040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Creating volume 8a61e103-b238-434b-8bd0-bc4770770c39 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:00 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8a61e103-b238-434b-8bd0-bc4770770c39 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c589ff2d-d275-439a-9cd4-39455d590e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:00 devstack sudo[89396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8a61e103-b238-434b-8bd0-bc4770770c39 1073741824
Apr 14 01:28:00 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a61ca77-a39e-49ca-9cd7-a7d48f0bbf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:00 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde (8800c052-a8d7-4a04-81fe-67dd6b64cbde): created successfully
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a61ca77-a39e-49ca-9cd7-a7d48f0bbf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Flow 'volume_create_manager' (328d7bba-a260-4061-a1dd-73d52b09e47a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:00 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-652c0f48-fe4b-4a46-91fc-871928ff0cf7 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Created volume successfully.
Apr 14 01:28:00 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8a61e103-b238-434b-8bd0-bc4770770c39 1073741824" returned: 0 in 0.531s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8a61e103-b238-434b-8bd0-bc4770770c39 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:00 devstack sudo[89402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8a61e103-b238-434b-8bd0-bc4770770c39
Apr 14 01:28:00 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:01 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8a61e103-b238-434b-8bd0-bc4770770c39" returned: 0 in 0.428s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.469s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-413459347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f171b43-7d13-44b8-81c5-be334bf14796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b368905e90854f35850955a5ba0cd36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:59Z,use_quota=True,user_id='8600559f966647c3b677a5fe86076040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Creating volume 8f171b43-7d13-44b8-81c5-be334bf14796 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:01 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8f171b43-7d13-44b8-81c5-be334bf14796 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce0cb78-1b9c-4bdf-a3d1-e0b5e1941216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a61e103-b238-434b-8bd0-bc4770770c39', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:01 devstack sudo[89405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8f171b43-7d13-44b8-81c5-be334bf14796 1073741824
Apr 14 01:28:01 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be10950d-f52e-44c1-aa5b-d022daff7e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:01 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume volume-8a61e103-b238-434b-8bd0-bc4770770c39 (8a61e103-b238-434b-8bd0-bc4770770c39): created successfully
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be10950d-f52e-44c1-aa5b-d022daff7e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Flow 'volume_create_manager' (8025d5b7-7aa5-4476-a9fb-3f9c50cd5248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:01 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-4538191a-064f-44d2-9ee2-7e78cd8a9d69 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Created volume successfully.
Apr 14 01:28:01 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8f171b43-7d13-44b8-81c5-be334bf14796 1073741824" returned: 0 in 0.494s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8f171b43-7d13-44b8-81c5-be334bf14796 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:01 devstack sudo[89410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8f171b43-7d13-44b8-81c5-be334bf14796
Apr 14 01:28:01 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:02 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8f171b43-7d13-44b8-81c5-be334bf14796" returned: 0 in 0.434s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.266s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-867490531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada11bb7-d747-45a8-bea1-54d90988c2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b368905e90854f35850955a5ba0cd36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:27:59Z,use_quota=True,user_id='8600559f966647c3b677a5fe86076040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Creating volume ada11bb7-d747-45a8-bea1-54d90988c2a1 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:02 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ada11bb7-d747-45a8-bea1-54d90988c2a1 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d816194-b548-490a-97e0-dd9bba7c3d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f171b43-7d13-44b8-81c5-be334bf14796', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff75bea4-2e08-456a-98a6-3a37ff8fed61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:02 devstack sudo[89413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ada11bb7-d747-45a8-bea1-54d90988c2a1 1073741824
Apr 14 01:28:02 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:02 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume volume-8f171b43-7d13-44b8-81c5-be334bf14796 (8f171b43-7d13-44b8-81c5-be334bf14796): created successfully
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff75bea4-2e08-456a-98a6-3a37ff8fed61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Flow 'volume_create_manager' (00852961-0374-43d5-9394-39a5585606c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:02 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2cf499ec-e540-4326-bb6c-e22c9d075162 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Created volume successfully.
Apr 14 01:28:02 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ada11bb7-d747-45a8-bea1-54d90988c2a1 1073741824" returned: 0 in 0.481s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ada11bb7-d747-45a8-bea1-54d90988c2a1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:02 devstack sudo[89418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ada11bb7-d747-45a8-bea1-54d90988c2a1
Apr 14 01:28:02 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:03 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ada11bb7-d747-45a8-bea1-54d90988c2a1" returned: 0 in 0.414s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cffe81-57d9-4a5c-bd8c-e2c6781bb012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada11bb7-d747-45a8-bea1-54d90988c2a1', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8749692-6726-4e74-b6d2-0e4dddbc14cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:03 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Volume volume-ada11bb7-d747-45a8-bea1-54d90988c2a1 (ada11bb7-d747-45a8-bea1-54d90988c2a1): created successfully
Apr 14 01:28:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8749692-6726-4e74-b6d2-0e4dddbc14cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:03 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Flow 'volume_create_manager' (5c908648-080e-43fb-ba6a-aab6e8b29ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:03 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2acabcbc-b973-447c-b846-77b988381d77 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Created volume successfully.
Apr 14 01:28:03 devstack cinder-volume[81812]: DEBUG oslo_service.periodic_task [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81812) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:28:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:04 devstack sudo[89421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:04 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-ada11bb7-d747-45a8-bea1-54d90988c2a1-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-ada11bb7-d747-45a8-bea1-54d90988c2a1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-quobyte-ada11bb7-d747-45a8-bea1-54d90988c2a1" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-ada11bb7-d747-45a8-bea1-54d90988c2a1" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:04 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[373e552e-8b4f-4fb9-9cd4-2993477c7e07]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ada11bb7-d747-45a8-bea1-54d90988c2a1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:04 devstack sudo[89423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ada11bb7-d747-45a8-bea1-54d90988c2a1
Apr 14 01:28:04 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:04 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.419s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:04 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:04 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ada11bb7-d747-45a8-bea1-54d90988c2a1" returned: 0 in 0.467s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ada11bb7-d747-45a8-bea1-54d90988c2a1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:04 devstack sudo[89429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ada11bb7-d747-45a8-bea1-54d90988c2a1
Apr 14 01:28:04 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:05 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-ada11bb7-d747-45a8-bea1-54d90988c2a1" returned: 0 in 0.420s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-ada11bb7-d747-45a8-bea1-54d90988c2a1" released by "delete_volume" :: held 0.912s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Created reservations ['83a3e024-04ea-4bed-a543-aa67d0010fa7', '953541aa-85b6-485c-8264-c25893ae2e90', 'e64ddf78-70f2-47c6-afe6-34816020c6ee', '0eb4219b-3dcd-4e44-a0b2-b9e1e225dede'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:05 devstack sudo[89438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:05 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-8f171b43-7d13-44b8-81c5-be334bf14796-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-8f171b43-7d13-44b8-81c5-be334bf14796-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-quobyte-8f171b43-7d13-44b8-81c5-be334bf14796" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-8f171b43-7d13-44b8-81c5-be334bf14796" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a51fd0-1db6-422c-8291-aa76a5fd436c]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8f171b43-7d13-44b8-81c5-be334bf14796 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:05 devstack sudo[89440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8f171b43-7d13-44b8-81c5-be334bf14796
Apr 14 01:28:05 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:05 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.445s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:05 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Deleted volume successfully.
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8ff8602a-5cfc-46ea-ad0f-c1d23df87378 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-ada11bb7-d747-45a8-bea1-54d90988c2a1-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:05 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8f171b43-7d13-44b8-81c5-be334bf14796" returned: 0 in 0.505s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8f171b43-7d13-44b8-81c5-be334bf14796 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:05 devstack sudo[89446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8f171b43-7d13-44b8-81c5-be334bf14796
Apr 14 01:28:05 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:06 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8f171b43-7d13-44b8-81c5-be334bf14796" returned: 0 in 0.399s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-8f171b43-7d13-44b8-81c5-be334bf14796" released by "delete_volume" :: held 0.929s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Created reservations ['80ac9e7a-1d3d-48fe-9094-8b85def782b9', '127903b7-6979-4299-9734-ae285254f2dd', 'c836b4d7-2be5-4132-beb5-e54b8788d7ec', '1c74814e-07ef-4018-a2cc-afd35a545229'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:06 devstack sudo[89449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:06 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-8a61e103-b238-434b-8bd0-bc4770770c39-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-8a61e103-b238-434b-8bd0-bc4770770c39-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-quobyte-8a61e103-b238-434b-8bd0-bc4770770c39" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-8a61e103-b238-434b-8bd0-bc4770770c39" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[db488589-8725-458a-a84e-bd8f65071c79]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8a61e103-b238-434b-8bd0-bc4770770c39 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:06 devstack sudo[89451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8a61e103-b238-434b-8bd0-bc4770770c39
Apr 14 01:28:06 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:06 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.445s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:06 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Deleted volume successfully.
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-dea010b9-4144-4ee5-a5d7-f4a632dc18fb tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-8f171b43-7d13-44b8-81c5-be334bf14796-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:06 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8a61e103-b238-434b-8bd0-bc4770770c39" returned: 0 in 0.468s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8a61e103-b238-434b-8bd0-bc4770770c39 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:06 devstack sudo[89457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8a61e103-b238-434b-8bd0-bc4770770c39
Apr 14 01:28:06 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:07 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8a61e103-b238-434b-8bd0-bc4770770c39" returned: 0 in 0.408s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-8a61e103-b238-434b-8bd0-bc4770770c39" released by "delete_volume" :: held 0.899s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Created reservations ['d5a798f4-7b46-48f7-88e9-de66adc0d631', 'ec061b53-6cb4-4673-b43c-84ce5ff6e902', 'bb7138c6-7d19-44b6-a775-652a7545f01f', '93e2668f-6d53-42b5-971d-c1de89217f7a'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:07 devstack sudo[89460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:07 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-8800c052-a8d7-4a04-81fe-67dd6b64cbde-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-8800c052-a8d7-4a04-81fe-67dd6b64cbde-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-quobyte-8800c052-a8d7-4a04-81fe-67dd6b64cbde" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-8800c052-a8d7-4a04-81fe-67dd6b64cbde" acquired by "delete_volume" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2e821d-9622-49c4-b161-b52a123894eb]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:07 devstack sudo[89463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde
Apr 14 01:28:07 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:07 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.443s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:07 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Deleted volume successfully.
Apr 14 01:28:07 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-5fb464fc-a94c-4b4a-84bd-c914a2c2f19b tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-8a61e103-b238-434b-8bd0-bc4770770c39-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:08 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde" returned: 0 in 0.463s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:08 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde
Apr 14 01:28:08 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:08 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8800c052-a8d7-4a04-81fe-67dd6b64cbde" returned: 0 in 0.416s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-8800c052-a8d7-4a04-81fe-67dd6b64cbde" released by "delete_volume" :: held 0.910s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Created reservations ['6a5d6dc7-0e6a-4c8f-9555-3675651a8b94', '53475511-ece4-4b5d-82f4-0ef13cea524a', '85f6e93e-7c12-451a-83df-78a1b8f134c2', '91676ae1-6f3c-444d-af67-78e27f2a5e28'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:08 devstack sudo[89472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:08 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-f321c043-4503-4654-a129-3aee2c454e34-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-f321c043-4503-4654-a129-3aee2c454e34-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-quobyte-f321c043-4503-4654-a129-3aee2c454e34" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-f321c043-4503-4654-a129-3aee2c454e34" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea478b8-5a33-4617-82cd-2298ee5321db]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f321c043-4503-4654-a129-3aee2c454e34 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:08 devstack sudo[89474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f321c043-4503-4654-a129-3aee2c454e34
Apr 14 01:28:08 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:08 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.425s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:08 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Deleted volume successfully.
Apr 14 01:28:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-192aabb2-44d8-4e63-b576-04f079991818 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-8800c052-a8d7-4a04-81fe-67dd6b64cbde-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:09 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f321c043-4503-4654-a129-3aee2c454e34" returned: 0 in 0.487s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f321c043-4503-4654-a129-3aee2c454e34 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:09 devstack sudo[89480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f321c043-4503-4654-a129-3aee2c454e34
Apr 14 01:28:09 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:09 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f321c043-4503-4654-a129-3aee2c454e34" returned: 0 in 0.414s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-f321c043-4503-4654-a129-3aee2c454e34" released by "delete_volume" :: held 0.922s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Created reservations ['287ccfae-a6ea-4da9-9f56-c0cd6e88613f', '00682db7-f2a4-4490-8ddb-424670452ea1', '51aa14be-541c-4a70-9fac-01dce069b7b6', 'b2da81e2-fe09-4d5b-8241-d0fd81ee210f'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:09 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:09 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-062dfff7-96cb-4323-8562-65f0d9260c2e-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-062dfff7-96cb-4323-8562-65f0d9260c2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-quobyte-d3085c80-357b-43b2-ad54-0834189c76b7" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-d3085c80-357b-43b2-ad54-0834189c76b7" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-quobyte-062dfff7-96cb-4323-8562-65f0d9260c2e" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-062dfff7-96cb-4323-8562-65f0d9260c2e" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Deleting offline snapshot 062dfff7-96cb-4323-8562-65f0d9260c2e of volume d3085c80-357b-43b2-ad54-0834189c76b7 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] snapshot_file for this snap is: volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[256f78de-12fd-4b93-8c0f-ad587d19c5e4]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:09 devstack sudo[89486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e
Apr 14 01:28:09 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:10 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.449s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:10 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:10 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Deleted volume successfully.
Apr 14 01:28:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2d1228c2-35ca-44b6-ba4c-75b3e4e0a995 tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-f321c043-4503-4654-a129-3aee2c454e34-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:10 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e" returned: 0 in 0.489s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3085c80-357b-43b2-ad54-0834189c76b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:28:10 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[370b50f0-ad1c-4063-9f46-6d9b7ef469b0]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:10 devstack sudo[89492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7
Apr 14 01:28:10 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:10 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7" returned: 0 in 0.463s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:10 devstack sudo[89497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e
Apr 14 01:28:10 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:11 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e" returned: 0 in 0.462s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:11 devstack sudo[89502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e
Apr 14 01:28:11 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:11 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7.062dfff7-96cb-4323-8562-65f0d9260c2e" returned: 0 in 0.413s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-062dfff7-96cb-4323-8562-65f0d9260c2e" released by "_delete_snapshot" :: held 1.881s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-d3085c80-357b-43b2-ad54-0834189c76b7" released by "delete_snapshot" :: held 1.890s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:11 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Created reservations ['1aa3fe06-0960-4320-98e9-22eded137b60', 'd815d156-aecf-486e-bd81-f680bc1cb23c', '9550afe9-8e9f-430e-9b49-08e8519f9332', '488b9648-a4b7-495a-a2ad-d6c3d4616cec'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:11 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Delete snapshot completed successfully.
Apr 14 01:28:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e8238815-295b-43ea-b3bc-c3e553bd3a6d tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-062dfff7-96cb-4323-8562-65f0d9260c2e-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-d3085c80-357b-43b2-ad54-0834189c76b7-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-d3085c80-357b-43b2-ad54-0834189c76b7-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "cinder-quobyte-d3085c80-357b-43b2-ad54-0834189c76b7" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-d3085c80-357b-43b2-ad54-0834189c76b7" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:11 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea730486-267e-4595-a55e-8fd10455c24a]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:11 devstack sudo[89505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7
Apr 14 01:28:11 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:12 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7" returned: 0 in 0.463s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:12 devstack sudo[89510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7
Apr 14 01:28:12 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:12 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-d3085c80-357b-43b2-ad54-0834189c76b7" returned: 0 in 0.410s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-quobyte-d3085c80-357b-43b2-ad54-0834189c76b7" released by "delete_volume" :: held 0.904s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:12 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Created reservations ['30df81b9-b2f0-491f-9d0c-60ef9c339c10', 'e45d4971-79c3-4f89-9cf9-c5aa28e1555a', 'f3ba8354-ae58-4bfb-b1bd-4278fa57e5d9', 'adb6bf17-a97f-4bf9-b50d-3aef292fca23'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:12 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:12 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:13 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.503s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:13 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:13 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Deleted volume successfully.
Apr 14 01:28:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d19ea7c5-133c-4f14-878a-db99c6910e3f tempest-CreateVolumesFromSnapshotTest-1133440944 None] Lock "cinder-d3085c80-357b-43b2-ad54-0834189c76b7-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Flow 'volume_create_manager' (47493a7a-3df4-4543-ae85-8a0240c822fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97c0627-a8b4-4350-945f-7ea9fb93865f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97c0627-a8b4-4350-945f-7ea9fb93865f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-106008143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f494f4df-1ee1-4484-a6fd-d9661a2e6143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3078efdea24a948769b5cfb4ab15d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:20Z,use_quota=True,user_id='f7c6d1bdb71f4cab9842e09988cfa104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49273081-8dad-4ceb-892b-dc87d11821e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49273081-8dad-4ceb-892b-dc87d11821e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c75bcdf-bf5a-4ab2-9e57-3964e8d51868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c75bcdf-bf5a-4ab2-9e57-3964e8d51868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f494f4df-1ee1-4484-a6fd-d9661a2e6143', 'volume_name': 'volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8099a459-de3e-4d8e-b8ff-84e593a5e069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8099a459-de3e-4d8e-b8ff-84e593a5e069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5358ab0-d961-409b-bdaf-8545b2e1cfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Volume f494f4df-1ee1-4484-a6fd-d9661a2e6143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143', 'volume_size': 1}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-106008143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f494f4df-1ee1-4484-a6fd-d9661a2e6143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3078efdea24a948769b5cfb4ab15d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:20Z,use_quota=True,user_id='f7c6d1bdb71f4cab9842e09988cfa104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Creating volume f494f4df-1ee1-4484-a6fd-d9661a2e6143 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:20 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:20 devstack sudo[89593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143 1073741824
Apr 14 01:28:20 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Flow 'volume_create_manager' (d2484cb6-a324-4ca3-9be4-43fecdf78108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b09bbe-cc88-4dcc-84b0-89acbe0ae20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b09bbe-cc88-4dcc-84b0-89acbe0ae20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-464706488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04e8ab8-8d1c-4983-aad5-ef37054eb850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756896daadb74695838413f9fb4b8cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:20Z,use_quota=True,user_id='946cf442bab54b1bbd005a0c69c8de7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8905632f-1024-4b63-982d-9f3dd597eb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8905632f-1024-4b63-982d-9f3dd597eb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104e61f0-3728-469f-a66b-7005e8f131e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104e61f0-3728-469f-a66b-7005e8f131e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a04e8ab8-8d1c-4983-aad5-ef37054eb850', 'volume_name': 'volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b731d689-4d10-46d6-a390-758821f9ae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b731d689-4d10-46d6-a390-758821f9ae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c1f310-7a42-40ca-b830-4f2fad26b50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Volume a04e8ab8-8d1c-4983-aad5-ef37054eb850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850', 'volume_size': 1}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Flow 'volume_create_manager' (c6923fb5-ccec-42fb-82b1-d9ca21f15b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49b0f23-481c-4c97-bb94-0c787111e5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49b0f23-481c-4c97-bb94-0c787111e5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1431540673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ed088a-9eef-4827-a8f7-b220dae68b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb8115d274b4c3cab745a3cd425f40b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:20Z,use_quota=True,user_id='5b9edc7d9ec548cc93bb23ae5d64d58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558c95d2-4b0c-47db-8d7a-d6b687bd8c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558c95d2-4b0c-47db-8d7a-d6b687bd8c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d03a4cc-4883-4627-894a-cfe4e5749f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d03a4cc-4883-4627-894a-cfe4e5749f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ed088a-9eef-4827-a8f7-b220dae68b9f', 'volume_name': 'volume-91ed088a-9eef-4827-a8f7-b220dae68b9f', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1fbd2d-4ad7-4128-b277-45e49d4b861e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1fbd2d-4ad7-4128-b277-45e49d4b861e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca3bdd6-d598-4665-9085-14d3799d99ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Volume 91ed088a-9eef-4827-a8f7-b220dae68b9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ed088a-9eef-4827-a8f7-b220dae68b9f', 'volume_size': 1}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Flow 'volume_create_manager' (05b75563-9d3d-4a4a-9659-50a43458b64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82389f5-4714-4c11-b3d1-68ee7d65640e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82389f5-4714-4c11-b3d1-68ee7d65640e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-199048704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f7c752-17e1-4e32-afee-21f77f4dd40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb8115d274b4c3cab745a3cd425f40b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:21Z,use_quota=True,user_id='5b9edc7d9ec548cc93bb23ae5d64d58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793a28d5-5bf5-4797-bb39-1fa37fdb2dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793a28d5-5bf5-4797-bb39-1fa37fdb2dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4baa09-8490-4c65-8d9f-f38c876e6c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4baa09-8490-4c65-8d9f-f38c876e6c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f7c752-17e1-4e32-afee-21f77f4dd40c', 'volume_name': 'volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae0822e-4c24-458d-b4aa-de5daef910c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae0822e-4c24-458d-b4aa-de5daef910c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b50c77-fc58-48b3-a0c7-970b3ad3c644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Volume a5f7c752-17e1-4e32-afee-21f77f4dd40c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c', 'volume_size': 1}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:20 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143 1073741824" returned: 0 in 0.713s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Flow 'volume_create_manager' (b89f59dd-b421-4d0a-98ac-8685721d8738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b1df7c-e0ec-4a3e-96d6-0a175f1f120b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:20 devstack sudo[89598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143
Apr 14 01:28:20 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b1df7c-e0ec-4a3e-96d6-0a175f1f120b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-435611802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb8115d274b4c3cab745a3cd425f40b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:21Z,use_quota=True,user_id='5b9edc7d9ec548cc93bb23ae5d64d58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a881088-f2bd-4b5d-9cd9-cf7ba2556ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a881088-f2bd-4b5d-9cd9-cf7ba2556ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c04b7d7-37c5-49e2-96f1-f00b1dea1343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c04b7d7-37c5-49e2-96f1-f00b1dea1343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d', 'volume_name': 'volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f560f52-c08b-4e28-962d-1038bff3d623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f560f52-c08b-4e28-962d-1038bff3d623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f3718f-741b-48fd-9f7d-9d55529ab50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:20 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Volume f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d', 'volume_size': 1}
Apr 14 01:28:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Flow 'volume_create_manager' (40610da2-3c7e-48f3-888f-6dce759302e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047e35d2-aa6a-424b-a05b-9c9b1d3de9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047e35d2-aa6a-424b-a05b-9c9b1d3de9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837343236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb95ba65-3cf4-4029-93d4-0d5c078d1d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb8115d274b4c3cab745a3cd425f40b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:21Z,use_quota=True,user_id='5b9edc7d9ec548cc93bb23ae5d64d58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dceae09d-1ee6-4864-b8cb-f1afbf932dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dceae09d-1ee6-4864-b8cb-f1afbf932dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (214b3dac-635a-493d-97c6-f7231ef93c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (214b3dac-635a-493d-97c6-f7231ef93c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb95ba65-3cf4-4029-93d4-0d5c078d1d6d', 'volume_name': 'volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c251758b-9ab8-4eeb-805d-266b63d9138a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c251758b-9ab8-4eeb-805d-266b63d9138a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60210495-c80e-4bfc-a24c-e5f8dae2872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:21 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Volume eb95ba65-3cf4-4029-93d4-0d5c078d1d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d', 'volume_size': 1}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Flow 'volume_create_manager' (a504a0a9-a68d-4896-aa5f-60065bb87dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd27cfd0-ff3a-451c-be76-99cbede711d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd27cfd0-ff3a-451c-be76-99cbede711d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1636413483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e54823-213a-4180-9920-976b572567d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb8115d274b4c3cab745a3cd425f40b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:21Z,use_quota=True,user_id='5b9edc7d9ec548cc93bb23ae5d64d58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e36e6e0-ff99-4265-a8b9-df26d236232f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e36e6e0-ff99-4265-a8b9-df26d236232f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea55d804-6b52-48a0-aaf4-e7376898da5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea55d804-6b52-48a0-aaf4-e7376898da5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e54823-213a-4180-9920-976b572567d0', 'volume_name': 'volume-79e54823-213a-4180-9920-976b572567d0', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480ea67a-602d-48b1-96f2-d45287e28e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480ea67a-602d-48b1-96f2-d45287e28e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2950af25-8b4d-438a-94fe-05ede3644159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:21 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Volume 79e54823-213a-4180-9920-976b572567d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e54823-213a-4180-9920-976b572567d0', 'volume_size': 1}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:21 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143" returned: 0 in 0.579s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-464706488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04e8ab8-8d1c-4983-aad5-ef37054eb850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756896daadb74695838413f9fb4b8cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:20Z,use_quota=True,user_id='946cf442bab54b1bbd005a0c69c8de7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Creating volume a04e8ab8-8d1c-4983-aad5-ef37054eb850 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:21 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5358ab0-d961-409b-bdaf-8545b2e1cfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5abb9de-5f8d-4308-bf44-99bf7e2c0355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:21 devstack sudo[89601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 1073741824
Apr 14 01:28:21 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:21 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Volume volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143 (f494f4df-1ee1-4484-a6fd-d9661a2e6143): created successfully
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5abb9de-5f8d-4308-bf44-99bf7e2c0355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:21 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Flow 'volume_create_manager' (47493a7a-3df4-4543-ae85-8a0240c822fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:21 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ce4ee6ff-f1d6-4b9d-9934-d2bfec553fff tempest-CreateVolumesFromSnapshotTest-669038 None] Created volume successfully.
Apr 14 01:28:22 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 1073741824" returned: 0 in 0.535s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:22 devstack sudo[89606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850
Apr 14 01:28:22 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:22 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850" returned: 0 in 0.506s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.196s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1431540673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ed088a-9eef-4827-a8f7-b220dae68b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb8115d274b4c3cab745a3cd425f40b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:20Z,use_quota=True,user_id='5b9edc7d9ec548cc93bb23ae5d64d58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Creating volume 91ed088a-9eef-4827-a8f7-b220dae68b9f {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:22 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91ed088a-9eef-4827-a8f7-b220dae68b9f 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c1f310-7a42-40ca-b830-4f2fad26b50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49270c1-5297-4ed5-b825-3369e5469a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:22 devstack sudo[89609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91ed088a-9eef-4827-a8f7-b220dae68b9f 1073741824
Apr 14 01:28:22 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:22 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Volume volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 (a04e8ab8-8d1c-4983-aad5-ef37054eb850): created successfully
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49270c1-5297-4ed5-b825-3369e5469a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:22 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Flow 'volume_create_manager' (d2484cb6-a324-4ca3-9be4-43fecdf78108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:22 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-7e464d10-a55e-40fb-a321-f34094ae0521 tempest-VolumeDependencyTests-194334341 None] Created volume successfully.
Apr 14 01:28:23 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91ed088a-9eef-4827-a8f7-b220dae68b9f 1073741824" returned: 0 in 0.552s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91ed088a-9eef-4827-a8f7-b220dae68b9f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:23 devstack sudo[89614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91ed088a-9eef-4827-a8f7-b220dae68b9f
Apr 14 01:28:23 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:23 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91ed088a-9eef-4827-a8f7-b220dae68b9f" returned: 0 in 0.517s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.982s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-199048704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f7c752-17e1-4e32-afee-21f77f4dd40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb8115d274b4c3cab745a3cd425f40b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:21Z,use_quota=True,user_id='5b9edc7d9ec548cc93bb23ae5d64d58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Creating volume a5f7c752-17e1-4e32-afee-21f77f4dd40c {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:23 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:23 devstack sudo[89617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c 1073741824
Apr 14 01:28:23 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca3bdd6-d598-4665-9085-14d3799d99ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ed088a-9eef-4827-a8f7-b220dae68b9f', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a95120-60ca-438f-9bed-729f10bacbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:23 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Volume volume-91ed088a-9eef-4827-a8f7-b220dae68b9f (91ed088a-9eef-4827-a8f7-b220dae68b9f): created successfully
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a95120-60ca-438f-9bed-729f10bacbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:23 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Flow 'volume_create_manager' (c6923fb5-ccec-42fb-82b1-d9ca21f15b1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:23 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-030472ff-41d4-46cb-8b43-2726d7df3f17 tempest-CreateVolumesFromImageTest-1231861780 None] Created volume successfully.
Apr 14 01:28:24 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c 1073741824" returned: 0 in 0.573s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:24 devstack sudo[89622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c
Apr 14 01:28:24 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:24 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c" returned: 0 in 0.508s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.832s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-435611802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb8115d274b4c3cab745a3cd425f40b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:21Z,use_quota=True,user_id='5b9edc7d9ec548cc93bb23ae5d64d58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Creating volume f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:24 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:24 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d 1073741824
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b50c77-fc58-48b3-a0c7-970b3ad3c644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:24 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89262596-6df7-4bdf-925a-d5f6a13211b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:24 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Volume volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c (a5f7c752-17e1-4e32-afee-21f77f4dd40c): created successfully
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89262596-6df7-4bdf-925a-d5f6a13211b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:24 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Flow 'volume_create_manager' (05b75563-9d3d-4a4a-9659-50a43458b64a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:24 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-13aeea61-dafb-452f-97e2-9fe7d633c287 tempest-CreateVolumesFromImageTest-1231861780 None] Created volume successfully.
Apr 14 01:28:25 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d 1073741824" returned: 0 in 0.523s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:25 devstack sudo[89630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d
Apr 14 01:28:25 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:25 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d" returned: 0 in 0.580s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.766s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837343236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb95ba65-3cf4-4029-93d4-0d5c078d1d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb8115d274b4c3cab745a3cd425f40b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:21Z,use_quota=True,user_id='5b9edc7d9ec548cc93bb23ae5d64d58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Creating volume eb95ba65-3cf4-4029-93d4-0d5c078d1d6d {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:25 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f3718f-741b-48fd-9f7d-9d55529ab50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb34a85-ef39-44b6-81e2-8187a3156574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:25 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Volume volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d (f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d): created successfully
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb34a85-ef39-44b6-81e2-8187a3156574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:25 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d 1073741824
Apr 14 01:28:25 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:25 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Flow 'volume_create_manager' (b89f59dd-b421-4d0a-98ac-8685721d8738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:25 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-67722c62-87f5-478c-bf5d-939c41d1391f tempest-CreateVolumesFromImageTest-1231861780 None] Created volume successfully.
Apr 14 01:28:26 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d 1073741824" returned: 0 in 0.539s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:26 devstack sudo[89638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d
Apr 14 01:28:26 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:26 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d" returned: 0 in 0.468s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.643s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1636413483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e54823-213a-4180-9920-976b572567d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb8115d274b4c3cab745a3cd425f40b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:21Z,use_quota=True,user_id='5b9edc7d9ec548cc93bb23ae5d64d58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Creating volume 79e54823-213a-4180-9920-976b572567d0 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:26 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-79e54823-213a-4180-9920-976b572567d0 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60210495-c80e-4bfc-a24c-e5f8dae2872f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2ac3b3-f87a-49de-ae84-e7c3a25d20b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:26 devstack sudo[89641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-79e54823-213a-4180-9920-976b572567d0 1073741824
Apr 14 01:28:26 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:26 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Volume volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d (eb95ba65-3cf4-4029-93d4-0d5c078d1d6d): created successfully
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2ac3b3-f87a-49de-ae84-e7c3a25d20b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:26 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Flow 'volume_create_manager' (40610da2-3c7e-48f3-888f-6dce759302e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:27 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-fdfd125e-b0ce-4f79-b4c2-93a2167cd811 tempest-CreateVolumesFromImageTest-1231861780 None] Created volume successfully.
Apr 14 01:28:27 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-79e54823-213a-4180-9920-976b572567d0 1073741824" returned: 0 in 0.524s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-79e54823-213a-4180-9920-976b572567d0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:27 devstack sudo[89647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-79e54823-213a-4180-9920-976b572567d0
Apr 14 01:28:27 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:27 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-79e54823-213a-4180-9920-976b572567d0" returned: 0 in 0.443s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.602s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:27 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] Creating offline snapshot c2b1c717-fb5e-4e89-a291-44b04dc39d84 of volume f494f4df-1ee1-4484-a6fd-d9661a2e6143 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:28:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2950af25-8b4d-438a-94fe-05ede3644159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e54823-213a-4180-9920-976b572567d0', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c67160-927f-4f68-93f3-b04b8e4f18c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:27 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31eb6a7-3a29-46fc-9583-3649e3acfdd8]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:27 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:27 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Volume volume-79e54823-213a-4180-9920-976b572567d0 (79e54823-213a-4180-9920-976b572567d0): created successfully
Apr 14 01:28:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c67160-927f-4f68-93f3-b04b8e4f18c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:27 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Flow 'volume_create_manager' (a504a0a9-a68d-4896-aa5f-60065bb87dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:28 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-28a85bde-4da6-4840-a925-2c37e7dee8a1 tempest-CreateVolumesFromImageTest-1231861780 None] Created volume successfully.
Apr 14 01:28:28 devstack sudo[89650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143
Apr 14 01:28:28 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:28 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143" returned: 0 in 0.531s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:28 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:28 devstack sudo[89655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84 1G
Apr 14 01:28:28 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:28 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "cinder-79e54823-213a-4180-9920-976b572567d0-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:28 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-79e54823-213a-4180-9920-976b572567d0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:28 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "cinder-quobyte-79e54823-213a-4180-9920-976b572567d0" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:29 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-quobyte-79e54823-213a-4180-9920-976b572567d0" acquired by "delete_volume" :: waited 0.013s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:29 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7a545d-7ef9-4b32-b51e-ab3eb2c8402d]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-79e54823-213a-4180-9920-976b572567d0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:29 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84 1G" returned: 0 in 0.612s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:29 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-79e54823-213a-4180-9920-976b572567d0
Apr 14 01:28:29 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:29 devstack sudo[89661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84
Apr 14 01:28:29 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:29 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84" returned: 0 in 0.455s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:29 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84 is being set with open permissions: ugo+rw
Apr 14 01:28:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:29 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-79e54823-213a-4180-9920-976b572567d0" returned: 0 in 0.539s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:29 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-79e54823-213a-4180-9920-976b572567d0 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:29 devstack sudo[89670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84
Apr 14 01:28:29 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:29 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-79e54823-213a-4180-9920-976b572567d0
Apr 14 01:28:29 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:30 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84" returned: 0 in 0.491s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:30 devstack sudo[89676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.info
Apr 14 01:28:30 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:30 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-79e54823-213a-4180-9920-976b572567d0" returned: 0 in 0.549s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-quobyte-79e54823-213a-4180-9920-976b572567d0" released by "delete_volume" :: held 1.148s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Created reservations ['8e488990-2f02-4251-85f0-dc55c24d3265', 'f1317e35-6556-4f5e-9f39-0e9d0c9f5127', '331faf38-ced7-4521-9403-a91195d4f5f0', 'f7936caa-a37f-4ca5-aacc-d180b693d149'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:30 devstack sudo[89678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:30 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:30 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.info" returned: 0 in 0.492s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:30 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.info is being set with open permissions: ugo+rw
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:30 devstack sudo[89681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.info
Apr 14 01:28:30 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:30 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.503s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:30 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Deleted volume successfully.
Apr 14 01:28:30 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7f6830f4-8da2-4488-9f22-2fa02e8e4b9e tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-79e54823-213a-4180-9920-976b572567d0-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:31 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.info" returned: 0 in 0.471s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.121s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.615s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] Creating offline snapshot c7e64e02-b7c2-448e-af35-00e6be3bb822 of volume a04e8ab8-8d1c-4983-aad5-ef37054eb850 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:28:31 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-5d256493-9b7f-49dc-ab09-acc13101a3d2 tempest-CreateVolumesFromSnapshotTest-669038 None] Create snapshot completed successfully
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf47882-a71b-4c42-9a57-714f0093763b]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "cinder-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:31 devstack sudo[89685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850
Apr 14 01:28:31 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "cinder-quobyte-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-quobyte-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccc4431-41d5-4df2-83b1-21fd5565408c]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:31 devstack sudo[89687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d
Apr 14 01:28:31 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:31 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850" returned: 0 in 0.587s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:31 devstack sudo[89695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822 1G
Apr 14 01:28:31 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:31 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d" returned: 0 in 0.561s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:31 devstack sudo[89697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d
Apr 14 01:28:31 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:31 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Flow 'volume_create_manager' (9bcc3677-8500-4c50-a158-589f369665bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471d8aac-6320-48f4-94d5-14bfa6d5ae25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471d8aac-6320-48f4-94d5-14bfa6d5ae25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-361174833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b876b4-4044-40a4-ae7d-96cb71efa4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3078efdea24a948769b5cfb4ab15d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:32Z,use_quota=True,user_id='f7c6d1bdb71f4cab9842e09988cfa104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806bcd67-f5a2-40f5-8bf7-cb5cf75d70ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806bcd67-f5a2-40f5-8bf7-cb5cf75d70ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39a8ad1-31f5-4915-8719-e77b09c90430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39a8ad1-31f5-4915-8719-e77b09c90430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b876b4-4044-40a4-ae7d-96cb71efa4c1', 'volume_name': 'volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e445109-df35-4a96-9705-86aea96f16bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e445109-df35-4a96-9705-86aea96f16bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259f2827-30d7-44a1-8054-3da08d1554a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Volume 46b876b4-4044-40a4-ae7d-96cb71efa4c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1', 'volume_size': 1}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Flow 'volume_create_manager' (0e249168-cc78-4d99-926b-d71b69e759cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defc2cbb-1802-4f82-a765-94efcf463dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defc2cbb-1802-4f82-a765-94efcf463dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2060418387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b0c02d-259c-4344-b453-34fa7979852d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3078efdea24a948769b5cfb4ab15d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:32Z,use_quota=True,user_id='f7c6d1bdb71f4cab9842e09988cfa104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061c20ce-fa5f-4810-96bb-56110b9b5717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061c20ce-fa5f-4810-96bb-56110b9b5717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017780ea-ebad-47f6-be51-56b56be9a54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017780ea-ebad-47f6-be51-56b56be9a54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5b0c02d-259c-4344-b453-34fa7979852d', 'volume_name': 'volume-c5b0c02d-259c-4344-b453-34fa7979852d', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6c8a90-7d21-451a-8d78-b03ff98c2532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6c8a90-7d21-451a-8d78-b03ff98c2532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72fdda1-64ea-4537-bfbb-7399f76e91e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Volume c5b0c02d-259c-4344-b453-34fa7979852d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5b0c02d-259c-4344-b453-34fa7979852d', 'volume_size': 1}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:32 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d" returned: 0 in 0.776s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-quobyte-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d" released by "delete_volume" :: held 1.379s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Flow 'volume_create_manager' (6f265d93-3df2-4407-9162-e10de873f740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ba326d-9b1a-470d-bb75-f9bbdd7366f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ba326d-9b1a-470d-bb75-f9bbdd7366f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-108467033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd09224-0c80-4640-a9f3-c522efb3c883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3078efdea24a948769b5cfb4ab15d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:33Z,use_quota=True,user_id='f7c6d1bdb71f4cab9842e09988cfa104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329e77ca-7bf1-419b-884a-d5f6707386f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329e77ca-7bf1-419b-884a-d5f6707386f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c077df-0b8c-429c-a8e4-bc16dab224bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c077df-0b8c-429c-a8e4-bc16dab224bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd09224-0c80-4640-a9f3-c522efb3c883', 'volume_name': 'volume-7dd09224-0c80-4640-a9f3-c522efb3c883', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe75078-07a3-430b-a008-3487ecfc4ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe75078-07a3-430b-a008-3487ecfc4ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eff7dcb-2b9c-4fd9-8611-2dc3d3d3dedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Volume 7dd09224-0c80-4640-a9f3-c522efb3c883: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd09224-0c80-4640-a9f3-c522efb3c883', 'volume_size': 1}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822 1G" returned: 0 in 1.069s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Created reservations ['99606c43-f3e0-45ad-861c-dc6890d9ea76', 'c3f5d189-b20a-44c7-b839-1f1ccee2d18a', '674eb6c0-5c20-42df-ad06-2e268bc24e2d', '27991536-8fc0-4570-be01-5567f9d0198d'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:32 devstack sudo[89703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822
Apr 14 01:28:32 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:32 devstack sudo[89705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:32 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Flow 'volume_create_manager' (80b0bd74-4c79-44b4-95e9-4fd22d1832e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de1fe328-7aa5-460e-a1a2-be12b266587d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de1fe328-7aa5-460e-a1a2-be12b266587d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2126261816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3078efdea24a948769b5cfb4ab15d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:33Z,use_quota=True,user_id='f7c6d1bdb71f4cab9842e09988cfa104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8435a0c-6c3a-44ef-bb3c-cd19a2622a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:32 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8435a0c-6c3a-44ef-bb3c-cd19a2622a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb10c96-cc07-4c3d-ba9b-42ca25073753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb10c96-cc07-4c3d-ba9b-42ca25073753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8', 'volume_name': 'volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3cba519-d6e3-49ca-8260-18d2c039c7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3cba519-d6e3-49ca-8260-18d2c039c7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5bbac1-87b0-4e8f-9834-db50f4bf6c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:33 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Volume 4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8', 'volume_size': 1}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Flow 'volume_create_manager' (65100af2-4a00-4ac9-862e-4b835499e6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21cce93a-8134-42d1-9c75-2659c5367dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21cce93a-8134-42d1-9c75-2659c5367dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-763597602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3135fe-05ae-4a28-83f1-31bfbf881a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3078efdea24a948769b5cfb4ab15d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:33Z,use_quota=True,user_id='f7c6d1bdb71f4cab9842e09988cfa104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f172255c-8011-43b6-af47-19081278b802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f172255c-8011-43b6-af47-19081278b802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de40384b-e36e-4f16-8640-4cf70794d0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de40384b-e36e-4f16-8640-4cf70794d0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c3135fe-05ae-4a28-83f1-31bfbf881a53', 'volume_name': 'volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21888ba7-2843-41ec-8508-9f3adbd87975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21888ba7-2843-41ec-8508-9f3adbd87975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a958d46f-e4aa-4fcc-800a-0db336bc5cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:33 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Volume 8c3135fe-05ae-4a28-83f1-31bfbf881a53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53', 'volume_size': 1}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "cinder-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:33 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "cinder-quobyte-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822" returned: 0 in 0.666s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:33 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822 is being set with open permissions: ugo+rw
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-quobyte-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d" acquired by "delete_volume" :: waited 0.026s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:33 devstack sudo[89711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822
Apr 14 01:28:33 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6ac2e5-3352-406e-8f17-8a5a3fac9849]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:33 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.678s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:33 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Deleted volume successfully.
Apr 14 01:28:33 devstack sudo[89713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d
Apr 14 01:28:33 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-886ff121-fba4-4eec-8955-9f2e21e25f20 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-eb95ba65-3cf4-4029-93d4-0d5c078d1d6d-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:33 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822" returned: 0 in 0.476s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:33 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:33 devstack sudo[89720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.info
Apr 14 01:28:33 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:34 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d" returned: 0 in 0.554s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:34 devstack sudo[89722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d
Apr 14 01:28:34 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:34 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.info" returned: 0 in 0.463s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:34 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.info is being set with open permissions: ugo+rw
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:34 devstack sudo[89725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.info
Apr 14 01:28:34 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:34 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d" returned: 0 in 0.487s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-quobyte-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d" released by "delete_volume" :: held 1.075s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Created reservations ['45dda8ef-6c5a-4843-a016-26678c4c66e7', '3b4761db-09e3-45a6-bf82-69421f5e07e0', '790abbcc-3dfe-444f-8e52-456fc98f2152', 'e2b56cb0-fdc1-44ba-ace6-e8a6c06e4f5c'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:34 devstack sudo[89728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:34 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:34 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.info" returned: 0 in 0.506s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.846s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.851s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-361174833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b876b4-4044-40a4-ae7d-96cb71efa4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3078efdea24a948769b5cfb4ab15d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:32Z,use_quota=True,user_id='f7c6d1bdb71f4cab9842e09988cfa104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Creating volume 46b876b4-4044-40a4-ae7d-96cb71efa4c1 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:34 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:34 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:34 devstack sudo[89732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1 1073741824
Apr 14 01:28:34 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:34 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-032d4d23-42d5-45cb-a976-27a4c62ab288 tempest-VolumeDependencyTests-194334341 None] Create snapshot completed successfully
Apr 14 01:28:35 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.465s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:35 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Deleted volume successfully.
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3407bb3d-6ff5-4532-97f1-0974790b1e6e tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-f9c3a412-c57a-4cbf-9aa5-facfbf2fb58d-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Flow 'volume_create_manager' (60f6f3a9-8465-45f2-bef1-e5257b5336d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd725bb-0fbb-4bd9-8851-b5238f1230cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd725bb-0fbb-4bd9-8851-b5238f1230cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1045559194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4eceb6-bb63-489f-b512-f54541c4eec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cd7067d0ec40df97dbef0ae4634024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:35Z,use_quota=True,user_id='8342abaa7f364cb9b15efb14632914a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f772c1d8-dfa8-40f5-91dc-39090639ca23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f772c1d8-dfa8-40f5-91dc-39090639ca23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272f6daa-3a80-4fb2-be54-8b3b756e17d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272f6daa-3a80-4fb2-be54-8b3b756e17d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d4eceb6-bb63-489f-b512-f54541c4eec8', 'volume_name': 'volume-3d4eceb6-bb63-489f-b512-f54541c4eec8', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4826805b-9f26-4a82-a23c-8bf8d065a828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4826805b-9f26-4a82-a23c-8bf8d065a828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a528d9a-b66a-49d6-9ea2-9f0f782a639a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:35 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Volume 3d4eceb6-bb63-489f-b512-f54541c4eec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d4eceb6-bb63-489f-b512-f54541c4eec8', 'volume_size': 1}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:35 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1 1073741824" returned: 0 in 0.541s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:35 devstack sudo[89739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1
Apr 14 01:28:35 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "cinder-a5f7c752-17e1-4e32-afee-21f77f4dd40c-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-a5f7c752-17e1-4e32-afee-21f77f4dd40c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "cinder-quobyte-a5f7c752-17e1-4e32-afee-21f77f4dd40c" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-quobyte-a5f7c752-17e1-4e32-afee-21f77f4dd40c" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ebee8f-432b-4f83-ad5a-b3fac961b79f]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:35 devstack sudo[89741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c
Apr 14 01:28:35 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:35 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1" returned: 0 in 0.446s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.688s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2060418387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b0c02d-259c-4344-b453-34fa7979852d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3078efdea24a948769b5cfb4ab15d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:32Z,use_quota=True,user_id='f7c6d1bdb71f4cab9842e09988cfa104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Creating volume c5b0c02d-259c-4344-b453-34fa7979852d {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:35 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c5b0c02d-259c-4344-b453-34fa7979852d 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259f2827-30d7-44a1-8054-3da08d1554a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:35 devstack sudo[89744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c5b0c02d-259c-4344-b453-34fa7979852d 1073741824
Apr 14 01:28:35 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640b96ff-ee6d-4eb2-a66b-e8ad795b7f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:35 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Volume volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1 (46b876b4-4044-40a4-ae7d-96cb71efa4c1): created successfully
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640b96ff-ee6d-4eb2-a66b-e8ad795b7f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:35 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Flow 'volume_create_manager' (9bcc3677-8500-4c50-a158-589f369665bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:36 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-0a0fc2ad-207f-4fd7-873c-58ecd5af6085 tempest-CreateVolumesFromSnapshotTest-669038 None] Created volume successfully.
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Flow 'volume_create_manager' (3ace6a22-1f36-4510-848c-1c7b7928e7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40746a8-a56f-41d1-b4b2-2ad3f70b8ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40746a8-a56f-41d1-b4b2-2ad3f70b8ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-792639225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f33bfdd-1026-4088-ac67-e55237aeea6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756896daadb74695838413f9fb4b8cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c7e64e02-b7c2-448e-af35-00e6be3bb822,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:36Z,use_quota=True,user_id='946cf442bab54b1bbd005a0c69c8de7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80cb01bc-149c-44fb-be01-a41eb4254c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80cb01bc-149c-44fb-be01-a41eb4254c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6777bc38-f2ca-4576-a9ad-9fc2b006fb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6777bc38-f2ca-4576-a9ad-9fc2b006fb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1f33bfdd-1026-4088-ac67-e55237aeea6b', 'volume_name': 'volume-1f33bfdd-1026-4088-ac67-e55237aeea6b', 'volume_size': 1, 'snapshot_id': 'c7e64e02-b7c2-448e-af35-00e6be3bb822'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348f10af-86d7-415d-91fb-6f4eca5cc12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348f10af-86d7-415d-91fb-6f4eca5cc12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96a3021-7afb-4177-95c0-ae41008b10ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:36 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Volume 1f33bfdd-1026-4088-ac67-e55237aeea6b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1f33bfdd-1026-4088-ac67-e55237aeea6b', 'volume_size': 1, 'snapshot_id': 'c7e64e02-b7c2-448e-af35-00e6be3bb822'}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:36 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c" returned: 0 in 0.575s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:36 devstack sudo[89749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c
Apr 14 01:28:36 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:36 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c5b0c02d-259c-4344-b453-34fa7979852d 1073741824" returned: 0 in 0.521s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c5b0c02d-259c-4344-b453-34fa7979852d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:36 devstack sudo[89754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c5b0c02d-259c-4344-b453-34fa7979852d
Apr 14 01:28:36 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:36 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a5f7c752-17e1-4e32-afee-21f77f4dd40c" returned: 0 in 0.463s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-quobyte-a5f7c752-17e1-4e32-afee-21f77f4dd40c" released by "delete_volume" :: held 1.058s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Created reservations ['014b3e67-74be-4519-955b-23cdddb3775c', '79f0074c-014f-4c5a-912d-f88aaef774e6', '551bc41e-2174-4053-833f-509b38d38e31', 'bdacb534-cba7-463b-931d-4798180b5e35'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:36 devstack sudo[89757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:36 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:36 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c5b0c02d-259c-4344-b453-34fa7979852d" returned: 0 in 0.440s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.175s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-108467033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd09224-0c80-4640-a9f3-c522efb3c883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3078efdea24a948769b5cfb4ab15d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:33Z,use_quota=True,user_id='f7c6d1bdb71f4cab9842e09988cfa104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Creating volume 7dd09224-0c80-4640-a9f3-c522efb3c883 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:36 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7dd09224-0c80-4640-a9f3-c522efb3c883 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72fdda1-64ea-4537-bfbb-7399f76e91e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5b0c02d-259c-4344-b453-34fa7979852d', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe41906-84df-42e4-b9a1-e255fd33c189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:36 devstack sudo[89760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7dd09224-0c80-4640-a9f3-c522efb3c883 1073741824
Apr 14 01:28:36 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:36 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Volume volume-c5b0c02d-259c-4344-b453-34fa7979852d (c5b0c02d-259c-4344-b453-34fa7979852d): created successfully
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe41906-84df-42e4-b9a1-e255fd33c189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:36 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Flow 'volume_create_manager' (0e249168-cc78-4d99-926b-d71b69e759cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:36 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e296e454-e77e-45ae-8d2c-443d2a096d72 tempest-CreateVolumesFromSnapshotTest-669038 None] Created volume successfully.
Apr 14 01:28:37 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.425s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:37 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Deleted volume successfully.
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2f502ab4-befa-4686-8b45-4ec3bac23dca tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-a5f7c752-17e1-4e32-afee-21f77f4dd40c-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:37 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7dd09224-0c80-4640-a9f3-c522efb3c883 1073741824" returned: 0 in 0.499s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7dd09224-0c80-4640-a9f3-c522efb3c883 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:37 devstack sudo[89767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7dd09224-0c80-4640-a9f3-c522efb3c883
Apr 14 01:28:37 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "cinder-91ed088a-9eef-4827-a8f7-b220dae68b9f-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-91ed088a-9eef-4827-a8f7-b220dae68b9f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "cinder-quobyte-91ed088a-9eef-4827-a8f7-b220dae68b9f" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-quobyte-91ed088a-9eef-4827-a8f7-b220dae68b9f" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e836325d-0bda-431d-9146-05a52d324638]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91ed088a-9eef-4827-a8f7-b220dae68b9f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:37 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:37 devstack sudo[89770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91ed088a-9eef-4827-a8f7-b220dae68b9f
Apr 14 01:28:37 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7dd09224-0c80-4640-a9f3-c522efb3c883" returned: 0 in 0.427s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.871s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2126261816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3078efdea24a948769b5cfb4ab15d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:33Z,use_quota=True,user_id='f7c6d1bdb71f4cab9842e09988cfa104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Creating volume 4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:37 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eff7dcb-2b9c-4fd9-8611-2dc3d3d3dedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd09224-0c80-4640-a9f3-c522efb3c883', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:37 devstack sudo[89772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8 1073741824
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66567a9d-e82e-4758-b6e1-eb921ac26b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:37 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:37 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Volume volume-7dd09224-0c80-4640-a9f3-c522efb3c883 (7dd09224-0c80-4640-a9f3-c522efb3c883): created successfully
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66567a9d-e82e-4758-b6e1-eb921ac26b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:37 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Flow 'volume_create_manager' (6f265d93-3df2-4407-9162-e10de873f740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:37 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-494ad8c7-027a-49d0-af50-cdaa61b91a18 tempest-CreateVolumesFromSnapshotTest-669038 None] Created volume successfully.
Apr 14 01:28:38 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91ed088a-9eef-4827-a8f7-b220dae68b9f" returned: 0 in 0.504s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91ed088a-9eef-4827-a8f7-b220dae68b9f {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:38 devstack sudo[89780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91ed088a-9eef-4827-a8f7-b220dae68b9f
Apr 14 01:28:38 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:38 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8 1073741824" returned: 0 in 0.530s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:38 devstack sudo[89782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8
Apr 14 01:28:38 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:38 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-91ed088a-9eef-4827-a8f7-b220dae68b9f" returned: 0 in 0.421s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-quobyte-91ed088a-9eef-4827-a8f7-b220dae68b9f" released by "delete_volume" :: held 0.950s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Created reservations ['4c0aed9f-53e2-4c76-ba7e-f81054754013', '7c90ec6e-1469-442e-b22b-114c2bb9c377', 'e2627a5e-2ae1-48ad-83cb-0823690e2f00', '31821589-a4df-42ab-a699-87dffb5938ce'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:38 devstack sudo[89786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:38 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:38 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8" returned: 0 in 0.476s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.667s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-763597602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3135fe-05ae-4a28-83f1-31bfbf881a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3078efdea24a948769b5cfb4ab15d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:33Z,use_quota=True,user_id='f7c6d1bdb71f4cab9842e09988cfa104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Creating volume 8c3135fe-05ae-4a28-83f1-31bfbf881a53 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:38 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5bbac1-87b0-4e8f-9834-db50f4bf6c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3b2b16-7dde-4fd9-91c3-c7ed35adb735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:38 devstack sudo[89788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53 1073741824
Apr 14 01:28:38 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:38 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Volume volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8 (4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8): created successfully
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3b2b16-7dde-4fd9-91c3-c7ed35adb735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:38 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Flow 'volume_create_manager' (80b0bd74-4c79-44b4-95e9-4fd22d1832e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:38 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f4ef3dbf-0532-4412-9a4f-7bdac5ff8864 tempest-CreateVolumesFromSnapshotTest-669038 None] Created volume successfully.
Apr 14 01:28:39 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.448s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:39 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:39 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Deleted volume successfully.
Apr 14 01:28:39 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-8201a3a9-d2fb-441d-bbd5-a5dd48e38996 tempest-CreateVolumesFromImageTest-1231861780 None] Lock "cinder-91ed088a-9eef-4827-a8f7-b220dae68b9f-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:39 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53 1073741824" returned: 0 in 0.634s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:39 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:39 devstack sudo[89794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53
Apr 14 01:28:39 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53" returned: 0 in 0.485s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.711s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:40 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1045559194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4eceb6-bb63-489f-b512-f54541c4eec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cd7067d0ec40df97dbef0ae4634024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:35Z,use_quota=True,user_id='8342abaa7f364cb9b15efb14632914a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Creating volume 3d4eceb6-bb63-489f-b512-f54541c4eec8 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:40 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a958d46f-e4aa-4fcc-800a-0db336bc5cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b0de71-6895-4707-bb16-546355e909df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:40 devstack sudo[89799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 1073741824
Apr 14 01:28:40 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:40 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Volume volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53 (8c3135fe-05ae-4a28-83f1-31bfbf881a53): created successfully
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b0de71-6895-4707-bb16-546355e909df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Flow 'volume_create_manager' (65100af2-4a00-4ac9-862e-4b835499e6bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:40 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-8e23fa4b-0211-4b87-a244-cd2160a33b0d tempest-CreateVolumesFromSnapshotTest-669038 None] Created volume successfully.
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Flow 'volume_create_manager' (ee9692b3-f19e-4b51-9a90-c5cec3f33391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af453998-7fc4-4a60-a6f3-f0071a9eeb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:40 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af453998-7fc4-4a60-a6f3-f0071a9eeb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5a1459-8de1-436d-86ed-b404edfff2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36988aa1c47f4a6590a7a901f9e141d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:41Z,use_quota=True,user_id='e3fda67c9a3447d69fda5248514ce6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abacd24-0e4c-4139-811f-2ec4c6d8660e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abacd24-0e4c-4139-811f-2ec4c6d8660e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645ca1be-5673-4103-b56b-426cacde1d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645ca1be-5673-4103-b56b-426cacde1d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c5a1459-8de1-436d-86ed-b404edfff2a8', 'volume_name': 'volume-5c5a1459-8de1-436d-86ed-b404edfff2a8', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4f238b-e3c7-464a-b216-8823442633fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4f238b-e3c7-464a-b216-8823442633fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60bb803-5120-4839-bd94-dc963ba609c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:40 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Volume 5c5a1459-8de1-436d-86ed-b404edfff2a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c5a1459-8de1-436d-86ed-b404edfff2a8', 'volume_size': 1}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 1073741824" returned: 0 in 0.600s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:40 devstack sudo[89804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8
Apr 14 01:28:40 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-8c3135fe-05ae-4a28-83f1-31bfbf881a53-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-8c3135fe-05ae-4a28-83f1-31bfbf881a53-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-quobyte-8c3135fe-05ae-4a28-83f1-31bfbf881a53" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-8c3135fe-05ae-4a28-83f1-31bfbf881a53" acquired by "delete_volume" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56b74e2-9135-447a-bed4-cd6eac34117f]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:40 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:40 devstack sudo[89806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53
Apr 14 01:28:40 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:41 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8" returned: 0 in 0.438s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.966s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-quobyte-c7e64e02-b7c2-448e-af35-00e6be3bb822-1f33bfdd-1026-4088-ac67-e55237aeea6b" by "_create_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a528d9a-b66a-49d6-9ea2-9f0f782a639a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d4eceb6-bb63-489f-b512-f54541c4eec8', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b7feb4-c4ba-4f62-8136-53c9903be706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-c7e64e02-b7c2-448e-af35-00e6be3bb822-1f33bfdd-1026-4088-ac67-e55237aeea6b" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Creating volume 1f33bfdd-1026-4088-ac67-e55237aeea6b from snapshot c7e64e02-b7c2-448e-af35-00e6be3bb822 {{(pid=81812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-quobyte-1f33bfdd-1026-4088-ac67-e55237aeea6b" by "_copy_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:41 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Volume volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 (3d4eceb6-bb63-489f-b512-f54541c4eec8): created successfully
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b7feb4-c4ba-4f62-8136-53c9903be706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Flow 'volume_create_manager' (60f6f3a9-8465-45f2-bef1-e5257b5336d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:41 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f989a277-8c9d-4828-b617-eb70deb87054 tempest-SnapshotDependencyTests-1599065305 None] Created volume successfully.
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-1f33bfdd-1026-4088-ac67-e55237aeea6b" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] snapshot: c7e64e02-b7c2-448e-af35-00e6be3bb822, volume: 1f33bfdd-1026-4088-ac67-e55237aeea6b,  {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d27b77f-ecee-4a68-a82f-d149654f6252]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:41 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53" returned: 0 in 0.485s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:41 devstack sudo[89812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822
Apr 14 01:28:41 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:41 devstack sudo[89813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53
Apr 14 01:28:41 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:41 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822" returned: 0 in 0.479s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Creating direct copy from snapshot {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b58be81-dc36-45cf-81a9-c2a84be7baf1]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:41 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-8c3135fe-05ae-4a28-83f1-31bfbf881a53" returned: 0 in 0.454s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-8c3135fe-05ae-4a28-83f1-31bfbf881a53" released by "delete_volume" :: held 0.974s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Created reservations ['be3ceb59-2828-44ab-8dce-c05e502f4c71', 'f2a0540b-34d1-470d-8b28-9e56e7157862', '5c99cdd1-d54c-4468-9e6e-4aca5783ac49', '67b3265f-484a-4eb0-aa38-b06c805d21e4'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:41 devstack sudo[89820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850
Apr 14 01:28:41 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:41 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:41 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:41 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:42 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850" returned: 0 in 0.505s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:42 devstack cinder-volume[81812]: DEBUG cinder.utils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Path /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b not found in is_blk_device check {{(pid=81812) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 14 01:28:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:42 devstack sudo[89828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b
Apr 14 01:28:42 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:42 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:42 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.422s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:42 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:42 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Deleted volume successfully.
Apr 14 01:28:42 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-59023717-d2c1-476d-a961-5de52befefe0 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-8c3135fe-05ae-4a28-83f1-31bfbf881a53-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:43 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:43 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:43 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-quobyte-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:43 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:43 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[093eefbb-0934-471a-8e7c-cebd974d09aa]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:43 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:43 devstack sudo[89840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8
Apr 14 01:28:43 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:44 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8" returned: 0 in 1.165s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:44 devstack sudo[89845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8
Apr 14 01:28:44 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:44 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b" returned: 0 in 2.154s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:44 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ab1467-c202-44fd-9315-ae392670d9dd]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:44 devstack sudo[89847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850
Apr 14 01:28:44 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:44 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8" returned: 0 in 0.411s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:44 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8" released by "delete_volume" :: held 1.626s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:44 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Created reservations ['fb580558-b14d-4812-b0d2-632cf1e11637', '3495d1f0-8091-4c50-94de-87c8f35e65b9', '80b888e1-c6dd-4549-8dd5-1cccc2d7eab7', '16c182ca-f121-45ce-9357-7e1783d61c5d'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:44 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:44 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:44 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:44 devstack sudo[89852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:44 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:45 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850" returned: 0 in 0.591s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:28:45 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Converted 1024.00 MB image at 474.97 MB/s
Apr 14 01:28:45 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b is being set with open permissions: ugo+rw
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:45 devstack sudo[89855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b
Apr 14 01:28:45 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:45 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.438s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:45 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Deleted volume successfully.
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-7dd09224-0c80-4640-a9f3-c522efb3c883-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-7dd09224-0c80-4640-a9f3-c522efb3c883-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-2950b73c-cb3f-411e-a73b-9161da251da4 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-4a0ff42c-5e30-4ad1-af9d-fb3b7ce303c8-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:SELECT=122,cinder:INSERT=45,cinder:UPDATE=177,cinder:DELETE=24 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:UPDATE=186,cinder:SELECT=136,cinder:INSERT=37,cinder:DELETE=12 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-quobyte-7dd09224-0c80-4640-a9f3-c522efb3c883" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-7dd09224-0c80-4640-a9f3-c522efb3c883" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ead9c3-35bb-460e-8699-0e647f431156]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7dd09224-0c80-4640-a9f3-c522efb3c883 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:45 devstack sudo[89858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7dd09224-0c80-4640-a9f3-c522efb3c883
Apr 14 01:28:45 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:45 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b" returned: 0 in 0.435s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-1f33bfdd-1026-4088-ac67-e55237aeea6b" released by "_copy_volume_from_snapshot" :: held 4.269s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-c7e64e02-b7c2-448e-af35-00e6be3bb822-1f33bfdd-1026-4088-ac67-e55237aeea6b" released by "_create_volume_from_snapshot" :: held 4.305s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.332s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.800s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5a1459-8de1-436d-86ed-b404edfff2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36988aa1c47f4a6590a7a901f9e141d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:41Z,use_quota=True,user_id='e3fda67c9a3447d69fda5248514ce6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Creating volume 5c5a1459-8de1-436d-86ed-b404edfff2a8 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:45 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5c5a1459-8de1-436d-86ed-b404edfff2a8 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:45 devstack sudo[89861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5c5a1459-8de1-436d-86ed-b404edfff2a8 1073741824
Apr 14 01:28:45 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96a3021-7afb-4177-95c0-ae41008b10ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f33bfdd-1026-4088-ac67-e55237aeea6b', 'volume_size': 1, 'snapshot_id': 'c7e64e02-b7c2-448e-af35-00e6be3bb822'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec9c30a-7883-4eab-ba31-7def5c6406ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:45 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Volume volume-1f33bfdd-1026-4088-ac67-e55237aeea6b (1f33bfdd-1026-4088-ac67-e55237aeea6b): created successfully
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec9c30a-7883-4eab-ba31-7def5c6406ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Flow 'volume_create_manager' (3ace6a22-1f36-4510-848c-1c7b7928e7a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:45 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ad7ab017-9ac4-43cd-8bf8-abcf30fc2fc8 tempest-VolumeDependencyTests-194334341 None] Created volume successfully.
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-c7e64e02-b7c2-448e-af35-00e6be3bb822-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Lock "cinder-c7e64e02-b7c2-448e-af35-00e6be3bb822-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-quobyte-a04e8ab8-8d1c-4983-aad5-ef37054eb850" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-a04e8ab8-8d1c-4983-aad5-ef37054eb850" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-quobyte-c7e64e02-b7c2-448e-af35-00e6be3bb822" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-c7e64e02-b7c2-448e-af35-00e6be3bb822" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Deleting offline snapshot c7e64e02-b7c2-448e-af35-00e6be3bb822 of volume a04e8ab8-8d1c-4983-aad5-ef37054eb850 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] snapshot_file for this snap is: volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3df0754-ad89-4d29-9405-7586daa39445]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:45 devstack sudo[89863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822
Apr 14 01:28:45 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:45 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7dd09224-0c80-4640-a9f3-c522efb3c883" returned: 0 in 0.496s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:45 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7dd09224-0c80-4640-a9f3-c522efb3c883 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:45 devstack sudo[89870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7dd09224-0c80-4640-a9f3-c522efb3c883
Apr 14 01:28:45 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:46 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5c5a1459-8de1-436d-86ed-b404edfff2a8 1073741824" returned: 0 in 0.531s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5c5a1459-8de1-436d-86ed-b404edfff2a8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:46 devstack sudo[89873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5c5a1459-8de1-436d-86ed-b404edfff2a8
Apr 14 01:28:46 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:46 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822" returned: 0 in 0.496s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[529ded94-4cc2-415d-8965-21ec20bd60f6]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:46 devstack sudo[89878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850
Apr 14 01:28:46 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:46 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-7dd09224-0c80-4640-a9f3-c522efb3c883" returned: 0 in 0.457s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-7dd09224-0c80-4640-a9f3-c522efb3c883" released by "delete_volume" :: held 0.977s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Created reservations ['152d2d14-6e20-42fc-a5bb-1c1d77419d52', 'bc8b2553-f3f5-4026-9587-1c385f7f8c86', 'de30d3b9-d43b-4275-9da2-c910f3a0dace', '2e63c2ca-1507-4f58-9f6c-75c87bc7787a'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:46 devstack sudo[89882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:46 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:46 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5c5a1459-8de1-436d-86ed-b404edfff2a8" returned: 0 in 0.452s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.671s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60bb803-5120-4839-bd94-dc963ba609c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5a1459-8de1-436d-86ed-b404edfff2a8', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ecbd1c5-7adc-4941-ba91-9d570be107e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] Creating offline snapshot 0c152b6d-8908-42ca-b6b4-b36c420c65be of volume 3d4eceb6-bb63-489f-b512-f54541c4eec8 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:28:46 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Volume volume-5c5a1459-8de1-436d-86ed-b404edfff2a8 (5c5a1459-8de1-436d-86ed-b404edfff2a8): created successfully
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ecbd1c5-7adc-4941-ba91-9d570be107e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Flow 'volume_create_manager' (ee9692b3-f19e-4b51-9a90-c5cec3f33391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9f37d1-b44c-43e5-a72c-081554e20ba8]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:46 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-80dd01d2-b7e4-40c2-b823-e58032a18a43 tempest-CinderUnicodeTest-1181162918 None] Created volume successfully.
Apr 14 01:28:46 devstack sudo[89884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8
Apr 14 01:28:46 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:46 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850" returned: 0 in 0.532s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:46 devstack sudo[89889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822
Apr 14 01:28:46 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:46 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.458s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:46 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Deleted volume successfully.
Apr 14 01:28:46 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e3fe9ffd-e3f5-45f8-b134-c2a36b9bb835 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-7dd09224-0c80-4640-a9f3-c522efb3c883-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:47 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8" returned: 0 in 0.510s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:47 devstack sudo[89895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be 1G
Apr 14 01:28:47 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:47 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822" returned: 0 in 0.503s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:47 devstack sudo[89900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822
Apr 14 01:28:47 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Flow 'volume_create_manager' (917eda5b-ef63-44b8-8aba-04182a792ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc95283-cf39-4676-8d03-7e9fc7b79b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc95283-cf39-4676-8d03-7e9fc7b79b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2040338035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b0c560-7f52-4a73-9581-be0c32c03a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36988aa1c47f4a6590a7a901f9e141d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:47Z,use_quota=True,user_id='e3fda67c9a3447d69fda5248514ce6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2129be2a-3a0a-4ff0-afb9-941529554be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2129be2a-3a0a-4ff0-afb9-941529554be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1e23fc-f07b-4684-a799-337e2ab0f733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1e23fc-f07b-4684-a799-337e2ab0f733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b0c560-7f52-4a73-9581-be0c32c03a65', 'volume_name': 'volume-b8b0c560-7f52-4a73-9581-be0c32c03a65', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7873720-0b12-49de-b39d-7e764a792d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7873720-0b12-49de-b39d-7e764a792d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b3486a-c7fa-4d4b-83e8-ca68647c973d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:47 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Volume b8b0c560-7f52-4a73-9581-be0c32c03a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b0c560-7f52-4a73-9581-be0c32c03a65', 'volume_size': 1}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-c5b0c02d-259c-4344-b453-34fa7979852d-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-c5b0c02d-259c-4344-b453-34fa7979852d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-quobyte-c5b0c02d-259c-4344-b453-34fa7979852d" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-c5b0c02d-259c-4344-b453-34fa7979852d" acquired by "delete_volume" :: waited 0.015s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3974f8-2996-4e45-9fa8-90c2a0ced7b6]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c5b0c02d-259c-4344-b453-34fa7979852d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:47 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be 1G" returned: 0 in 0.536s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:47 devstack sudo[89907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be
Apr 14 01:28:47 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:47 devstack sudo[89906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c5b0c02d-259c-4344-b453-34fa7979852d
Apr 14 01:28:47 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:47 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850.c7e64e02-b7c2-448e-af35-00e6be3bb822" returned: 0 in 0.485s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-c7e64e02-b7c2-448e-af35-00e6be3bb822" released by "_delete_snapshot" :: held 2.075s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-a04e8ab8-8d1c-4983-aad5-ef37054eb850" released by "delete_snapshot" :: held 2.086s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Created reservations ['71a3cea8-c815-491e-8d48-f760ea2825a8', '3ae885bd-9988-4aba-95e7-18a5b4ae13e6', '95826a16-0e76-4bf1-bf8b-913224c31592', '52ed5b8d-14d0-4490-a624-312e7f3656c8'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:47 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Delete snapshot completed successfully.
Apr 14 01:28:47 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e2310b5a-d9f1-4e16-906a-61c4aac593a4 tempest-VolumeDependencyTests-194334341 None] Lock "cinder-c7e64e02-b7c2-448e-af35-00e6be3bb822-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:48 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c5b0c02d-259c-4344-b453-34fa7979852d" returned: 0 in 0.499s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c5b0c02d-259c-4344-b453-34fa7979852d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:48 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be" returned: 0 in 0.475s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:48 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be is being set with open permissions: ugo+rw
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:48 devstack sudo[89917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c5b0c02d-259c-4344-b453-34fa7979852d
Apr 14 01:28:48 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:48 devstack sudo[89918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be
Apr 14 01:28:48 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:48 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be" returned: 0 in 0.405s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:48 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-c5b0c02d-259c-4344-b453-34fa7979852d" returned: 0 in 0.447s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-c5b0c02d-259c-4344-b453-34fa7979852d" released by "delete_volume" :: held 0.974s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:48 devstack sudo[89923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.info
Apr 14 01:28:48 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Created reservations ['da077f69-ea9d-4990-b7f8-7857dfd7c716', '2bc7d4f0-7aed-4dd0-a487-e8207dda7996', '003fde32-98f1-4a14-a826-c66e05db592e', 'b7cb9d13-0e4c-47a2-88bf-8f54798f37e5'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:48 devstack sudo[89925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:48 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-a04e8ab8-8d1c-4983-aad5-ef37054eb850-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Lock "cinder-a04e8ab8-8d1c-4983-aad5-ef37054eb850-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-quobyte-a04e8ab8-8d1c-4983-aad5-ef37054eb850" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-a04e8ab8-8d1c-4983-aad5-ef37054eb850" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b1d034-46db-4382-ab3e-949e9df77abd]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:48 devstack sudo[89928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850
Apr 14 01:28:48 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:48 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.info" returned: 0 in 0.451s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:48 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.info is being set with open permissions: ugo+rw
Apr 14 01:28:48 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:48 devstack sudo[89931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.info
Apr 14 01:28:48 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:49 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.427s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:49 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Deleted volume successfully.
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9e67c964-b667-4077-adf3-23830a101a72 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-c5b0c02d-259c-4344-b453-34fa7979852d-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:49 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:49 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850" returned: 0 in 0.481s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.info" returned: 0 in 0.414s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.870s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.921s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:49 devstack sudo[89937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2040338035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b0c560-7f52-4a73-9581-be0c32c03a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36988aa1c47f4a6590a7a901f9e141d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:47Z,use_quota=True,user_id='e3fda67c9a3447d69fda5248514ce6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Creating volume b8b0c560-7f52-4a73-9581-be0c32c03a65 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:49 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:49 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:49 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c019c3ef-4e4f-4f4e-93ff-a3022ae9679a tempest-SnapshotDependencyTests-1599065305 None] Create snapshot completed successfully
Apr 14 01:28:49 devstack sudo[89939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65 1073741824
Apr 14 01:28:49 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-46b876b4-4044-40a4-ae7d-96cb71efa4c1-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-46b876b4-4044-40a4-ae7d-96cb71efa4c1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-quobyte-46b876b4-4044-40a4-ae7d-96cb71efa4c1" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-46b876b4-4044-40a4-ae7d-96cb71efa4c1" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bb6520-92b4-4054-b6fe-898445d6c0f3]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:49 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-a04e8ab8-8d1c-4983-aad5-ef37054eb850" returned: 0 in 0.448s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-a04e8ab8-8d1c-4983-aad5-ef37054eb850" released by "delete_volume" :: held 0.970s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:49 devstack sudo[89943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1
Apr 14 01:28:49 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Created reservations ['36d0213d-fb4d-42da-8553-c14bfad5e300', '647f6932-fdd2-4ac5-8564-25b075105728', '03aa46e3-5b14-4cb4-a65a-329b1500f192', '74408f30-c80b-455b-b7a8-b8317740b1c3'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:49 devstack sudo[89947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:49 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:49 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65 1073741824" returned: 0 in 0.563s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:49 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:50 devstack sudo[89949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65
Apr 14 01:28:50 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Flow 'volume_create_manager' (125bcfb9-bec0-4542-8448-c54b88c64b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bca46d0-e15e-4ddd-ade0-b82e61a1a5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bca46d0-e15e-4ddd-ade0-b82e61a1a5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1722183804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f2f916-c58e-45ce-b0d4-73bc52e47130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756896daadb74695838413f9fb4b8cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:50Z,use_quota=True,user_id='946cf442bab54b1bbd005a0c69c8de7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f96e63-a820-44cc-8ae3-4d8343fb4d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f96e63-a820-44cc-8ae3-4d8343fb4d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b3f605-8887-4444-bc72-29a5c45c8038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b3f605-8887-4444-bc72-29a5c45c8038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f2f916-c58e-45ce-b0d4-73bc52e47130', 'volume_name': 'volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bad5fe-fde0-43b3-abde-760cd6a29152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bad5fe-fde0-43b3-abde-760cd6a29152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2586e37-4c25-433e-bd46-67c2737a2379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:50 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Volume e1f2f916-c58e-45ce-b0d4-73bc52e47130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130', 'volume_size': 1}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:50 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.432s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:50 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Deleted volume successfully.
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-79175c6b-cf17-4776-ba99-48139e2ce5ca tempest-VolumeDependencyTests-194334341 None] Lock "cinder-a04e8ab8-8d1c-4983-aad5-ef37054eb850-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:50 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1" returned: 0 in 0.639s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:50 devstack sudo[89955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1
Apr 14 01:28:50 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:50 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65" returned: 0 in 0.605s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.273s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1722183804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f2f916-c58e-45ce-b0d4-73bc52e47130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756896daadb74695838413f9fb4b8cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:50Z,use_quota=True,user_id='946cf442bab54b1bbd005a0c69c8de7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Creating volume e1f2f916-c58e-45ce-b0d4-73bc52e47130 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:50 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:50 devstack sudo[89958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 1073741824
Apr 14 01:28:50 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b3486a-c7fa-4d4b-83e8-ca68647c973d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b0c560-7f52-4a73-9581-be0c32c03a65', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74dc865-33ae-4219-8bf8-6d8fc4cc762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:50 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Volume volume-b8b0c560-7f52-4a73-9581-be0c32c03a65 (b8b0c560-7f52-4a73-9581-be0c32c03a65): created successfully
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74dc865-33ae-4219-8bf8-6d8fc4cc762e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Flow 'volume_create_manager' (917eda5b-ef63-44b8-8aba-04182a792ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:50 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9fad7fa0-1abd-469f-a2d4-19e00b95386d tempest-CinderUnicodeTest-1181162918 None] Created volume successfully.
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Flow 'volume_create_manager' (147761a2-ee76-43af-be4a-82c7bced4484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fa3ed4-e2bb-4ba2-94f8-611754324e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fa3ed4-e2bb-4ba2-94f8-611754324e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c033ac-257f-4277-83be-f8357afb3de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cd7067d0ec40df97dbef0ae4634024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0c152b6d-8908-42ca-b6b4-b36c420c65be,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:51Z,use_quota=True,user_id='8342abaa7f364cb9b15efb14632914a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba3013e-fc67-480e-a915-c1392b87e8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba3013e-fc67-480e-a915-c1392b87e8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a10f99f-023e-405f-8238-68d43dc6e8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a10f99f-023e-405f-8238-68d43dc6e8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '04c033ac-257f-4277-83be-f8357afb3de8', 'volume_name': 'volume-04c033ac-257f-4277-83be-f8357afb3de8', 'volume_size': 1, 'snapshot_id': '0c152b6d-8908-42ca-b6b4-b36c420c65be'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150d4524-2e6d-4427-9d4a-584d42ee84e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150d4524-2e6d-4427-9d4a-584d42ee84e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b59ad9-411d-466b-97f0-cfdabe783cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:50 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Volume 04c033ac-257f-4277-83be-f8357afb3de8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-04c033ac-257f-4277-83be-f8357afb3de8', 'volume_size': 1, 'snapshot_id': '0c152b6d-8908-42ca-b6b4-b36c420c65be'}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:50 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-46b876b4-4044-40a4-ae7d-96cb71efa4c1" returned: 0 in 0.480s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-46b876b4-4044-40a4-ae7d-96cb71efa4c1" released by "delete_volume" :: held 1.138s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Created reservations ['6485ad57-590c-4f82-abed-e675749e4522', 'ca19df61-eb42-4ae1-a246-f05096817864', 'ce594d96-935b-4c88-bec5-31dfa9ff46b4', 'c536d4f8-323d-440d-8147-9ef712522fc2'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:50 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:50 devstack sudo[89963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:50 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:51 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 1073741824" returned: 0 in 0.507s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:51 devstack sudo[89966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130
Apr 14 01:28:51 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:51 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.448s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:51 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Deleted volume successfully.
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1f5addf1-17ab-4268-9ee7-c0697db7fb56 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-46b876b4-4044-40a4-ae7d-96cb71efa4c1-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:51 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130" returned: 0 in 0.422s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.831s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "cinder-quobyte-0c152b6d-8908-42ca-b6b4-b36c420c65be-04c033ac-257f-4277-83be-f8357afb3de8" by "_create_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2586e37-4c25-433e-bd46-67c2737a2379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e65446-5d15-4f32-b87f-18ee1f47ef1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:51 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Volume volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 (e1f2f916-c58e-45ce-b0d4-73bc52e47130): created successfully
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e65446-5d15-4f32-b87f-18ee1f47ef1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Flow 'volume_create_manager' (125bcfb9-bec0-4542-8448-c54b88c64b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-quobyte-0c152b6d-8908-42ca-b6b4-b36c420c65be-04c033ac-257f-4277-83be-f8357afb3de8" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Creating volume 04c033ac-257f-4277-83be-f8357afb3de8 from snapshot 0c152b6d-8908-42ca-b6b4-b36c420c65be {{(pid=81812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "cinder-quobyte-04c033ac-257f-4277-83be-f8357afb3de8" by "_copy_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:51 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d109cb69-e4b7-4972-a3ea-4c2046378413 tempest-VolumeDependencyTests-194334341 None] Created volume successfully.
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-quobyte-04c033ac-257f-4277-83be-f8357afb3de8" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] snapshot: 0c152b6d-8908-42ca-b6b4-b36c420c65be, volume: 04c033ac-257f-4277-83be-f8357afb3de8,  {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[854fcf86-190e-4f79-8518-3e60163af7f0]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:51 devstack sudo[89970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be
Apr 14 01:28:51 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-c2b1c717-fb5e-4e89-a291-44b04dc39d84-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-c2b1c717-fb5e-4e89-a291-44b04dc39d84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-quobyte-f494f4df-1ee1-4484-a6fd-d9661a2e6143" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-f494f4df-1ee1-4484-a6fd-d9661a2e6143" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-quobyte-c2b1c717-fb5e-4e89-a291-44b04dc39d84" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-c2b1c717-fb5e-4e89-a291-44b04dc39d84" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Deleting offline snapshot c2b1c717-fb5e-4e89-a291-44b04dc39d84 of volume f494f4df-1ee1-4484-a6fd-d9661a2e6143 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] snapshot_file for this snap is: volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8234c527-0dd8-4fbc-bc09-701cd6dd02c1]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:51 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:51 devstack sudo[89972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84
Apr 14 01:28:51 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:52 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be" returned: 0 in 0.468s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d4eceb6-bb63-489f-b512-f54541c4eec8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Creating direct copy from snapshot {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e445381-60fd-4de9-aa28-c982e134b1d7]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:52 devstack sudo[89977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8
Apr 14 01:28:52 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:52 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84" returned: 0 in 0.493s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8682994-df2a-49e1-b3b4-734deb266d2f]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:52 devstack sudo[89982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143
Apr 14 01:28:52 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Flow 'volume_create_manager' (6f1b5971-d471-4818-9fbe-72963e8c05d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:52 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4aed133-795b-4ec1-b24d-9a06d931402d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8" returned: 0 in 0.512s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.utils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Path /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8 not found in is_blk_device check {{(pid=81812) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:52 devstack sudo[89987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8
Apr 14 01:28:52 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4aed133-795b-4ec1-b24d-9a06d931402d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-986909762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1f246f-6b6c-4461-842b-b2ada73a5624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756896daadb74695838413f9fb4b8cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e1f2f916-c58e-45ce-b0d4-73bc52e47130,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:53Z,use_quota=True,user_id='946cf442bab54b1bbd005a0c69c8de7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9309933c-d35f-45b5-97b6-d632600b2c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9309933c-d35f-45b5-97b6-d632600b2c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75659732-cfa5-409c-83e9-2a25a22bb167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75659732-cfa5-409c-83e9-2a25a22bb167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fc1f246f-6b6c-4461-842b-b2ada73a5624', 'volume_name': 'volume-fc1f246f-6b6c-4461-842b-b2ada73a5624', 'volume_size': 1, 'source_volid': 'e1f2f916-c58e-45ce-b0d4-73bc52e47130', 'source_volstatus': 'available'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a25e16-e8dc-4034-9974-8e8ee0c222a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a25e16-e8dc-4034-9974-8e8ee0c222a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173a7d32-9024-4391-9195-15751457b020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:52 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Volume fc1f246f-6b6c-4461-842b-b2ada73a5624: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fc1f246f-6b6c-4461-842b-b2ada73a5624', 'volume_size': 1, 'source_volid': 'e1f2f916-c58e-45ce-b0d4-73bc52e47130', 'source_volstatus': 'available'}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:52 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143" returned: 0 in 0.552s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:52 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:53 devstack sudo[89994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84
Apr 14 01:28:53 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:54 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84" returned: 0 in 1.149s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:54 devstack sudo[90008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84
Apr 14 01:28:54 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:54 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8" returned: 0 in 2.072s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:54 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6499031d-863a-4b91-8ce6-ee3ad18c5a0d]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:54 devstack sudo[90010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8
Apr 14 01:28:54 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:54 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:54 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143.c2b1c717-fb5e-4e89-a291-44b04dc39d84" returned: 0 in 0.728s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-c2b1c717-fb5e-4e89-a291-44b04dc39d84" released by "_delete_snapshot" :: held 2.982s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-f494f4df-1ee1-4484-a6fd-d9661a2e6143" released by "delete_snapshot" :: held 2.997s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:54 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Created reservations ['209a4209-3ca3-4d04-bba0-b9425b4731ff', 'e1007645-69e4-492f-a178-b69ebccd798d', 'd6883b1b-a9d0-4ec2-93a0-1042d9d3069a', '7f12e662-94c8-47b9-975e-3e002438cf23'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:54 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Delete snapshot completed successfully.
Apr 14 01:28:54 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0d2a6995-ac5e-4fea-9189-4a68bc652043 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-c2b1c717-fb5e-4e89-a291-44b04dc39d84-delete_snapshot" released by "delete_snapshot" :: held 3.074s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-f494f4df-1ee1-4484-a6fd-d9661a2e6143-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-f494f4df-1ee1-4484-a6fd-d9661a2e6143-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "cinder-quobyte-f494f4df-1ee1-4484-a6fd-d9661a2e6143" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-f494f4df-1ee1-4484-a6fd-d9661a2e6143" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[33955e58-a78a-43a6-899b-84224225a4c6]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:55 devstack sudo[90013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143
Apr 14 01:28:55 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:55 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8" returned: 0 in 0.618s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8 {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:28:55 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Converted 1024.00 MB image at 494.02 MB/s
Apr 14 01:28:55 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8 is being set with open permissions: ugo+rw
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:55 devstack sudo[90018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8
Apr 14 01:28:55 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:55 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143" returned: 0 in 0.491s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:55 devstack sudo[90023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143
Apr 14 01:28:55 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:55 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8" returned: 0 in 0.454s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-quobyte-04c033ac-257f-4277-83be-f8357afb3de8" released by "_copy_volume_from_snapshot" :: held 4.189s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-quobyte-0c152b6d-8908-42ca-b6b4-b36c420c65be-04c033ac-257f-4277-83be-f8357afb3de8" released by "_create_volume_from_snapshot" :: held 4.216s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.248s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] Creating offline snapshot e3f46fff-5531-454e-a2d7-d7a63c75ed8c of volume b8b0c560-7f52-4a73-9581-be0c32c03a65 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b59ad9-411d-466b-97f0-cfdabe783cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c033ac-257f-4277-83be-f8357afb3de8', 'volume_size': 1, 'snapshot_id': '0c152b6d-8908-42ca-b6b4-b36c420c65be'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0966e1f5-216d-49bc-80bf-4b4fb3dfccce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5d35f9-10b9-4348-9eb3-1dfeaf94d1b2]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:55 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Volume volume-04c033ac-257f-4277-83be-f8357afb3de8 (04c033ac-257f-4277-83be-f8357afb3de8): created successfully
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0966e1f5-216d-49bc-80bf-4b4fb3dfccce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:55 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Flow 'volume_create_manager' (147761a2-ee76-43af-be4a-82c7bced4484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:55 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d48d9762-39df-48f5-a5ff-517031cec7d3 tempest-SnapshotDependencyTests-1599065305 None] Created volume successfully.
Apr 14 01:28:55 devstack sudo[90026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65
Apr 14 01:28:55 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:56 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f494f4df-1ee1-4484-a6fd-d9661a2e6143" returned: 0 in 0.435s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "cinder-0c152b6d-8908-42ca-b6b4-b36c420c65be-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-quobyte-f494f4df-1ee1-4484-a6fd-d9661a2e6143" released by "delete_volume" :: held 0.961s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-0c152b6d-8908-42ca-b6b4-b36c420c65be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "cinder-quobyte-3d4eceb6-bb63-489f-b512-f54541c4eec8" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-quobyte-3d4eceb6-bb63-489f-b512-f54541c4eec8" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "cinder-quobyte-0c152b6d-8908-42ca-b6b4-b36c420c65be" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-quobyte-0c152b6d-8908-42ca-b6b4-b36c420c65be" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Deleting offline snapshot 0c152b6d-8908-42ca-b6b4-b36c420c65be of volume 3d4eceb6-bb63-489f-b512-f54541c4eec8 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] snapshot_file for this snap is: volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Created reservations ['6e2e1d8b-3ed2-4e17-8acd-700f3a434c42', 'c542492b-6eed-4d14-98be-0e10bdfcdb22', 'd71d1f6c-ae4e-433a-8eae-624e0aa7c72b', '47e7f84e-a5c3-40fc-bcb2-9c4271b7bb45'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bec6aea-0852-4b4d-b81f-242544ff287e]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:56 devstack sudo[90030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:28:56 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:56 devstack sudo[90029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be
Apr 14 01:28:56 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:56 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65" returned: 0 in 0.554s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:56 devstack sudo[90036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c 1G
Apr 14 01:28:56 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:56 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.421s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:28:56 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Deleted volume successfully.
Apr 14 01:28:56 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-89c416c1-9f10-4aa5-b15a-d9c7b5a15a59 tempest-CreateVolumesFromSnapshotTest-669038 None] Lock "cinder-f494f4df-1ee1-4484-a6fd-d9661a2e6143-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be" returned: 0 in 0.491s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d4eceb6-bb63-489f-b512-f54541c4eec8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c01d766-32ad-46fc-b8f2-ef71ee4f19cc]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:56 devstack sudo[90042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8
Apr 14 01:28:56 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:56 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c 1G" returned: 0 in 0.492s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:56 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b0c560-7f52-4a73-9581-be0c32c03a65 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:56 devstack sudo[90047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b0c560-7f52-4a73-9581-be0c32c03a65 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c
Apr 14 01:28:56 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:57 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8" returned: 0 in 0.482s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:57 devstack sudo[90052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be
Apr 14 01:28:57 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:57 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b0c560-7f52-4a73-9581-be0c32c03a65 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c" returned: 0 in 0.479s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:57 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c is being set with open permissions: ugo+rw
Apr 14 01:28:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:57 devstack sudo[90057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c
Apr 14 01:28:57 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:57 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be" returned: 0 in 0.484s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:57 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be
Apr 14 01:28:57 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:57 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c" returned: 0 in 0.501s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:57 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:57 devstack sudo[90067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.info
Apr 14 01:28:57 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:58 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8.0c152b6d-8908-42ca-b6b4-b36c420c65be" returned: 0 in 0.526s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-quobyte-0c152b6d-8908-42ca-b6b4-b36c420c65be" released by "_delete_snapshot" :: held 2.055s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-quobyte-3d4eceb6-bb63-489f-b512-f54541c4eec8" released by "delete_snapshot" :: held 2.073s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:58 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Created reservations ['0adbc9cb-d286-4665-ae32-5405e49878f8', 'eac00348-1af5-4e55-88bd-c0db5856256f', '707a85ae-2f6a-41da-87d7-d9c873e76410', 'b523b25e-a533-4963-80de-57cbd35cec6c'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:28:58 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Delete snapshot completed successfully.
Apr 14 01:28:58 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a8f5b4e3-d5d5-4acd-81e6-1694cc75cf95 tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-0c152b6d-8908-42ca-b6b4-b36c420c65be-delete_snapshot" released by "delete_snapshot" :: held 2.156s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:28:58 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.info" returned: 0 in 0.505s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:58 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.info is being set with open permissions: ugo+rw
Apr 14 01:28:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:58 devstack sudo[90071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.info
Apr 14 01:28:58 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:58 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.info" returned: 0 in 0.423s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.034s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:28:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.151s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:28:58 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Cloning volume e1f2f916-c58e-45ce-b0d4-73bc52e47130 to volume fc1f246f-6b6c-4461-842b-b2ada73a5624
Apr 14 01:28:58 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-a25112d4-a331-4b45-af15-0b06e445c39c tempest-CinderUnicodeTest-1181162918 None] Create snapshot completed successfully
Apr 14 01:28:58 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Creating offline snapshot 68099b85-9756-48bf-bb04-27edffc4d1d9 of volume e1f2f916-c58e-45ce-b0d4-73bc52e47130 {{(pid=81812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 14 01:28:58 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b8f76d-3b89-4fa2-8e2c-36c840b9cf5d]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:58 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:58 devstack sudo[90074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130
Apr 14 01:28:58 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Flow 'volume_create_manager' (d1228ecd-0955-4e8a-87b2-0ba8b933e92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e99d7c-4e4f-4ce7-9ce5-ce62eb6b90f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e99d7c-4e4f-4ce7-9ce5-ce62eb6b90f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1570123074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6dd2c18-9bdf-418e-981e-2aea1a1dcbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379dee878e79445daff871608705a038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:59Z,use_quota=True,user_id='dfc23bb59eb24d60b266064559e809dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f0fa84-c630-449e-8e45-51c9165047e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f0fa84-c630-449e-8e45-51c9165047e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4c191b-bad7-4fff-b53c-7a82b846e0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4c191b-bad7-4fff-b53c-7a82b846e0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6dd2c18-9bdf-418e-981e-2aea1a1dcbce', 'volume_name': 'volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ced6a6-f4f7-4f96-a7ed-6967489ad46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ced6a6-f4f7-4f96-a7ed-6967489ad46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b29a1b-4ea7-41bb-a49f-1ee23c24be42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:28:59 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume f6dd2c18-9bdf-418e-981e-2aea1a1dcbce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce', 'volume_size': 1}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Acquiring lock "cinder-e3f46fff-5531-454e-a2d7-d7a63c75ed8c-delete_snapshot" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Lock "cinder-e3f46fff-5531-454e-a2d7-d7a63c75ed8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Acquiring lock "cinder-quobyte-b8b0c560-7f52-4a73-9581-be0c32c03a65" by "delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Lock "cinder-quobyte-b8b0c560-7f52-4a73-9581-be0c32c03a65" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Acquiring lock "cinder-quobyte-e3f46fff-5531-454e-a2d7-d7a63c75ed8c" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Lock "cinder-quobyte-e3f46fff-5531-454e-a2d7-d7a63c75ed8c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Deleting offline snapshot e3f46fff-5531-454e-a2d7-d7a63c75ed8c of volume b8b0c560-7f52-4a73-9581-be0c32c03a65 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] snapshot_file for this snap is: volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0f6e8b-ed98-45f1-91da-5ff298f6f27f]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "cinder-3d4eceb6-bb63-489f-b512-f54541c4eec8-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-3d4eceb6-bb63-489f-b512-f54541c4eec8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:59 devstack sudo[90076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c
Apr 14 01:28:59 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "cinder-quobyte-3d4eceb6-bb63-489f-b512-f54541c4eec8" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-quobyte-3d4eceb6-bb63-489f-b512-f54541c4eec8" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1be773-bc07-49ab-9fea-e9291fb41b99]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:59 devstack sudo[90078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8
Apr 14 01:28:59 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:59 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130" returned: 0 in 0.543s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9 1G {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:59 devstack sudo[90083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9 1G
Apr 14 01:28:59 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:59 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c" returned: 0 in 0.525s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8b0c560-7f52-4a73-9581-be0c32c03a65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f8fc63-77ef-4adc-bfad-14018f26ea94]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:59 devstack sudo[90089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65
Apr 14 01:28:59 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:28:59 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8" returned: 0 in 0.548s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:28:59 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:28:59 devstack sudo[90094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8
Apr 14 01:28:59 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:00 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9 1G" returned: 0 in 0.571s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:00 devstack sudo[90099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9
Apr 14 01:29:00 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:00 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65" returned: 0 in 0.528s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:00 devstack sudo[90105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c
Apr 14 01:29:00 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:00 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-3d4eceb6-bb63-489f-b512-f54541c4eec8" returned: 0 in 0.463s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-quobyte-3d4eceb6-bb63-489f-b512-f54541c4eec8" released by "delete_volume" :: held 1.052s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Created reservations ['ef8b65f6-0909-459c-ae6f-2fb555c093fb', 'b97eaceb-11cf-43e0-a79e-8dd6cb730e95', 'b4550855-53d1-4670-8936-a6be60e900e1', '5e953012-31e7-4338-a459-74afb158fb9f'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:00 devstack sudo[90107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:29:00 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:00 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 -F qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9" returned: 0 in 0.483s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:00 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9 is being set with open permissions: ugo+rw
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:00 devstack sudo[90112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9
Apr 14 01:29:00 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:00 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c" returned: 0 in 0.474s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:00 devstack sudo[90117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c
Apr 14 01:29:00 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:00 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.426s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:29:00 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Deleted volume successfully.
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-1fb281b1-bab6-4575-9798-01d49a9aac41 tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-3d4eceb6-bb63-489f-b512-f54541c4eec8-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:00 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:00 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9" returned: 0 in 0.471s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:01 devstack sudo[90121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.info
Apr 14 01:29:01 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:01 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65.e3f46fff-5531-454e-a2d7-d7a63c75ed8c" returned: 0 in 0.443s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Lock "cinder-quobyte-e3f46fff-5531-454e-a2d7-d7a63c75ed8c" released by "_delete_snapshot" :: held 2.038s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Lock "cinder-quobyte-b8b0c560-7f52-4a73-9581-be0c32c03a65" released by "delete_snapshot" :: held 2.050s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Created reservations ['8cc6aa98-3618-4602-b008-38b2791cff19', '875080fc-9903-4560-897c-51fc7d6b8439', 'bee4f86b-bb8d-4a95-a5fb-d9c6bf9f738b', '2dd15d21-42a3-4fb7-a7a7-ea94d6c631a5'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:29:01 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Delete snapshot completed successfully.
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-b97d5d47-19c6-4235-807b-317e418f35d7 tempest-CinderUnicodeTest-1181162918 None] Lock "cinder-e3f46fff-5531-454e-a2d7-d7a63c75ed8c-delete_snapshot" released by "delete_snapshot" :: held 2.140s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "cinder-04c033ac-257f-4277-83be-f8357afb3de8-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-04c033ac-257f-4277-83be-f8357afb3de8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "cinder-quobyte-04c033ac-257f-4277-83be-f8357afb3de8" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-quobyte-04c033ac-257f-4277-83be-f8357afb3de8" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4ba680-d7ae-456f-824d-1f5f25e5fa6a]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:01 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.info" returned: 0 in 0.498s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:01 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.info is being set with open permissions: ugo+rw
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.info {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:01 devstack sudo[90126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.info
Apr 14 01:29:01 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:01 devstack sudo[90125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8
Apr 14 01:29:01 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:01 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.info" returned: 0 in 0.420s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-quobyte-fc1f246f-6b6c-4461-842b-b2ada73a5624" by "_copy_volume_from_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-fc1f246f-6b6c-4461-842b-b2ada73a5624" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] snapshot: 68099b85-9756-48bf-bb04-27edffc4d1d9, volume: fc1f246f-6b6c-4461-842b-b2ada73a5624,  {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1d2793-8190-49c6-9902-2ced8f02d00d]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:01 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8" returned: 0 in 0.496s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:01 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:01 devstack sudo[90134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8
Apr 14 01:29:01 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:02 devstack sudo[90133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9
Apr 14 01:29:02 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Acquiring lock "cinder-b8b0c560-7f52-4a73-9581-be0c32c03a65-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Lock "cinder-b8b0c560-7f52-4a73-9581-be0c32c03a65-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Acquiring lock "cinder-quobyte-b8b0c560-7f52-4a73-9581-be0c32c03a65" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Lock "cinder-quobyte-b8b0c560-7f52-4a73-9581-be0c32c03a65" acquired by "delete_volume" :: waited 0.012s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e886a65f-5ef2-46eb-8002-5312a9c59c06]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:02 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65
Apr 14 01:29:02 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:02 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-04c033ac-257f-4277-83be-f8357afb3de8" returned: 0 in 0.441s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-quobyte-04c033ac-257f-4277-83be-f8357afb3de8" released by "delete_volume" :: held 0.972s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Created reservations ['b30c8084-cf3e-4e2c-a707-fda8982340ae', 'db5e43c8-95e1-4b21-9501-dda39a9995a4', 'ada2ac46-bb89-4650-9822-53c737433827', '735ece4d-7d36-4b5e-b4b7-f373daa5c0a7'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:29:02 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9" returned: 0 in 0.495s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Creating direct copy from snapshot {{(pid=81812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f64cf3-7153-41c7-902f-4ed196b510fb]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:02 devstack sudo[90143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130
Apr 14 01:29:02 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:02 devstack sudo[90144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:29:02 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:02 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65" returned: 0 in 0.519s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:02 devstack sudo[90150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65
Apr 14 01:29:02 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:02 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.458s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:29:02 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Deleted volume successfully.
Apr 14 01:29:02 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130" returned: 0 in 0.526s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG cinder.utils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Path /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624 not found in is_blk_device check {{(pid=81812) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 14 01:29:02 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0c89cebe-7f29-490a-abce-efecde12361c tempest-SnapshotDependencyTests-1599065305 None] Lock "cinder-04c033ac-257f-4277-83be-f8357afb3de8-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:03 devstack sudo[90156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624
Apr 14 01:29:03 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:03 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-b8b0c560-7f52-4a73-9581-be0c32c03a65" returned: 0 in 0.467s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Lock "cinder-quobyte-b8b0c560-7f52-4a73-9581-be0c32c03a65" released by "delete_volume" :: held 1.016s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Created reservations ['b65c76b8-29be-4881-999f-3876fbfce210', 'c2ecf7ed-9923-41f9-8c93-55ffe0217e0c', '2517f90a-5cd5-4cec-bd2e-44b297c9b871', '4d7abda5-d82c-42fc-8641-5f874fc28d76'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:03 devstack sudo[90162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:29:03 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG oslo_service.periodic_task [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81812) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:03 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:04 devstack sudo[90173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:29:04 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Acquiring lock "cinder-5c5a1459-8de1-436d-86ed-b404edfff2a8-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Lock "cinder-5c5a1459-8de1-436d-86ed-b404edfff2a8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Acquiring lock "cinder-quobyte-5c5a1459-8de1-436d-86ed-b404edfff2a8" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:04 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Lock "cinder-quobyte-5c5a1459-8de1-436d-86ed-b404edfff2a8" acquired by "delete_volume" :: waited 0.049s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:04 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6e4343-88a5-4510-8040-711e944518b2]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:04 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5c5a1459-8de1-436d-86ed-b404edfff2a8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:05 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 1.068s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:05 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9101f62a-329f-4a51-b1a3-7d010bcdb544 None None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:29:05 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 1.709s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:05 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:29:05 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Deleted volume successfully.
Apr 14 01:29:05 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d3304150-3189-4ab8-a84d-20db6dea09e2 tempest-CinderUnicodeTest-1181162918 None] Lock "cinder-b8b0c560-7f52-4a73-9581-be0c32c03a65-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:05 devstack sudo[90183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5c5a1459-8de1-436d-86ed-b404edfff2a8
Apr 14 01:29:05 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:05 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624" returned: 0 in 2.336s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:05 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b61d28-9bda-4426-a2f5-72b8c23215bf]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:05 devstack sudo[90185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130
Apr 14 01:29:05 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:05 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5c5a1459-8de1-436d-86ed-b404edfff2a8" returned: 0 in 0.741s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:05 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5c5a1459-8de1-436d-86ed-b404edfff2a8 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:05 devstack sudo[90190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5c5a1459-8de1-436d-86ed-b404edfff2a8
Apr 14 01:29:05 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:06 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130" returned: 0 in 0.731s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG cinder.image.image_utils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130, size 1024.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624 {{(pid=81812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 14 01:29:06 devstack cinder-volume[81812]: INFO cinder.image.image_utils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Converted 1024.00 MB image at 438.11 MB/s
Apr 14 01:29:06 devstack cinder-volume[81812]: WARNING cinder.volume.drivers.remotefs [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624 is being set with open permissions: ugo+rw
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:06 devstack sudo[90195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624
Apr 14 01:29:06 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:06 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-5c5a1459-8de1-436d-86ed-b404edfff2a8" returned: 0 in 0.507s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Lock "cinder-quobyte-5c5a1459-8de1-436d-86ed-b404edfff2a8" released by "delete_volume" :: held 1.319s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Created reservations ['9d221d85-1381-4c0c-82be-aa690cacdf5e', '801d2253-2bb1-4413-970e-41e7fbd1d381', '81ad3790-67d4-4749-b89c-80f8610b9415', '405f7e77-2114-46ff-b1ea-b75596098c14'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:06 devstack sudo[90199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:29:06 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:06 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624" returned: 0 in 0.478s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-fc1f246f-6b6c-4461-842b-b2ada73a5624" released by "_copy_volume_from_snapshot" :: held 4.616s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-quobyte-68099b85-9756-48bf-bb04-27edffc4d1d9" by "_delete_snapshot" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-68099b85-9756-48bf-bb04-27edffc4d1d9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Deleting offline snapshot 68099b85-9756-48bf-bb04-27edffc4d1d9 of volume e1f2f916-c58e-45ce-b0d4-73bc52e47130 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] snapshot_file for this snap is: volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9 {{(pid=81812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b766b73a-22be-4e85-b8c5-53eecc61bfa9]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:06 devstack sudo[90202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9
Apr 14 01:29:06 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:06 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.473s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:29:06 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Deleted volume successfully.
Apr 14 01:29:06 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d013c0a0-75f8-472f-974d-b5e9250b3eda tempest-CinderUnicodeTest-1181162918 None] Lock "cinder-5c5a1459-8de1-436d-86ed-b404edfff2a8-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:07 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9" returned: 0 in 0.576s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:07 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 14 01:29:07 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[da400144-33fb-4c1d-b3e2-e7104fc196b5]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:07 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130
Apr 14 01:29:07 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:07 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130" returned: 0 in 0.594s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:07 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:07 devstack sudo[90215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9
Apr 14 01:29:07 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:08 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9" returned: 0 in 0.565s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:08 devstack sudo[90220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9
Apr 14 01:29:08 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:08 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130.68099b85-9756-48bf-bb04-27edffc4d1d9" returned: 0 in 0.496s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-68099b85-9756-48bf-bb04-27edffc4d1d9" released by "_delete_snapshot" :: held 2.298s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.061s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.861s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1570123074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6dd2c18-9bdf-418e-981e-2aea1a1dcbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379dee878e79445daff871608705a038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:28:59Z,use_quota=True,user_id='dfc23bb59eb24d60b266064559e809dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Creating volume f6dd2c18-9bdf-418e-981e-2aea1a1dcbce {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:29:08 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:08 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce 1073741824
Apr 14 01:29:08 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173a7d32-9024-4391-9195-15751457b020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc1f246f-6b6c-4461-842b-b2ada73a5624', 'volume_size': 1, 'source_volid': 'e1f2f916-c58e-45ce-b0d4-73bc52e47130', 'source_volstatus': 'available'}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebab9cbb-f68e-4e78-8d1c-6a1bc7fa369b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:08 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Volume volume-fc1f246f-6b6c-4461-842b-b2ada73a5624 (fc1f246f-6b6c-4461-842b-b2ada73a5624): created successfully
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebab9cbb-f68e-4e78-8d1c-6a1bc7fa369b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:08 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Flow 'volume_create_manager' (6f1b5971-d471-4818-9fbe-72963e8c05d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:29:08 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-0984bfe1-2d7a-48ef-80e9-dea4ee05f69b tempest-VolumeDependencyTests-194334341 None] Created volume successfully.
Apr 14 01:29:09 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce 1073741824" returned: 0 in 0.548s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:09 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce
Apr 14 01:29:09 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-e1f2f916-c58e-45ce-b0d4-73bc52e47130-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Lock "cinder-e1f2f916-c58e-45ce-b0d4-73bc52e47130-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-quobyte-e1f2f916-c58e-45ce-b0d4-73bc52e47130" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:09 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-e1f2f916-c58e-45ce-b0d4-73bc52e47130" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:09 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[46000c1e-808b-4922-ae18-dd33495b9b14]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:09 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:10 devstack sudo[90233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130
Apr 14 01:29:10 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:10 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce" returned: 0 in 0.549s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b29a1b-4ea7-41bb-a49f-1ee23c24be42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89066e34-64aa-4950-8cd2-a48675daa247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:10 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce (f6dd2c18-9bdf-418e-981e-2aea1a1dcbce): created successfully
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89066e34-64aa-4950-8cd2-a48675daa247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Flow 'volume_create_manager' (d1228ecd-0955-4e8a-87b2-0ba8b933e92d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:29:10 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-ecd84082-b2eb-4ff1-a6d7-806bbcfb4b70 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Created volume successfully.
Apr 14 01:29:10 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130" returned: 0 in 0.525s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:10 devstack sudo[90238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130
Apr 14 01:29:10 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:10 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-e1f2f916-c58e-45ce-b0d4-73bc52e47130" returned: 0 in 0.423s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-e1f2f916-c58e-45ce-b0d4-73bc52e47130" released by "delete_volume" :: held 0.979s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Created reservations ['16850677-e472-4f4c-ad0d-cfad45ecd329', '6ea5466d-7e42-4663-b9ae-92ab296cfb99', '334c513e-482a-4c5b-8bcf-1cd3130d1352', 'a9f34eb6-657c-49a1-a49d-b391ca1c0dbc'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:10 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:11 devstack sudo[90241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:29:11 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Flow 'volume_create_manager' (a4dffd24-b56a-435e-aae7-d3d418eb368d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4f339b-275b-413e-a828-53da66956f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4f339b-275b-413e-a828-53da66956f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-454316932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e694f0d-d78b-43ef-bcdf-bf024d2dedc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379dee878e79445daff871608705a038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:29:11Z,use_quota=True,user_id='dfc23bb59eb24d60b266064559e809dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88cc7524-6ddb-4140-8682-b010019f2c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88cc7524-6ddb-4140-8682-b010019f2c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d282702b-c5d3-4a86-916c-1edb63ff5fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d282702b-c5d3-4a86-916c-1edb63ff5fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e694f0d-d78b-43ef-bcdf-bf024d2dedc9', 'volume_name': 'volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5323d7db-e019-46d6-a070-cbda5f2b7b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5323d7db-e019-46d6-a070-cbda5f2b7b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2173d6f6-a281-4016-ad49-8e144f7daa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume 4e694f0d-d78b-43ef-bcdf-bf024d2dedc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9', 'volume_size': 1}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-454316932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e694f0d-d78b-43ef-bcdf-bf024d2dedc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379dee878e79445daff871608705a038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:29:11Z,use_quota=True,user_id='dfc23bb59eb24d60b266064559e809dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Creating volume 4e694f0d-d78b-43ef-bcdf-bf024d2dedc9 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:29:11 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:11 devstack sudo[90243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9 1073741824
Apr 14 01:29:11 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Flow 'volume_create_manager' (d4e64ae1-73ba-454b-8429-c41cf0775d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22e7fd76-98a4-4bb9-890d-1a27fed62ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22e7fd76-98a4-4bb9-890d-1a27fed62ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-954864404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ca1c7f-50db-4237-a836-68151166608d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379dee878e79445daff871608705a038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:29:11Z,use_quota=True,user_id='dfc23bb59eb24d60b266064559e809dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d4d615-ddbe-46bb-82bb-c7d640b9c6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d4d615-ddbe-46bb-82bb-c7d640b9c6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953c650a-c6af-4926-bd04-2bc7d404ce8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953c650a-c6af-4926-bd04-2bc7d404ce8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ca1c7f-50db-4237-a836-68151166608d', 'volume_name': 'volume-94ca1c7f-50db-4237-a836-68151166608d', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbfe822-a7f8-4a00-9a5e-82cc8fd82682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbfe822-a7f8-4a00-9a5e-82cc8fd82682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6359f2ac-2f8a-4c5f-8b71-c70e8a898135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume 94ca1c7f-50db-4237-a836-68151166608d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ca1c7f-50db-4237-a836-68151166608d', 'volume_size': 1}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:11 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.477s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:29:11 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Deleted volume successfully.
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e66afaed-128a-4f48-ab09-c20bd817ab1c tempest-VolumeDependencyTests-194334341 None] Lock "cinder-e1f2f916-c58e-45ce-b0d4-73bc52e47130-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Flow 'volume_create_manager' (5c07d54f-7386-4d6f-ad6c-0ff21234c2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637db73a-80c0-40c8-b2bb-40830bcb9b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637db73a-80c0-40c8-b2bb-40830bcb9b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-415178671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab969c4-fdc5-4f83-a03b-1efdb9673987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379dee878e79445daff871608705a038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:29:11Z,use_quota=True,user_id='dfc23bb59eb24d60b266064559e809dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44a8406-05b7-4973-b5df-d60687797ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44a8406-05b7-4973-b5df-d60687797ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f743273-7127-4f62-9752-d38d1fd9153f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f743273-7127-4f62-9752-d38d1fd9153f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aab969c4-fdc5-4f83-a03b-1efdb9673987', 'volume_name': 'volume-aab969c4-fdc5-4f83-a03b-1efdb9673987', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e244925-af87-4151-ad43-b73490d9dfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e244925-af87-4151-ad43-b73490d9dfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a823cad-8019-477b-afda-f2220f802d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume aab969c4-fdc5-4f83-a03b-1efdb9673987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aab969c4-fdc5-4f83-a03b-1efdb9673987', 'volume_size': 1}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Flow 'volume_create_manager' (a8f8334d-03b2-4041-b4ae-281998d60022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce74d10-f2a3-4d4b-a5e7-2c1329af3c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce74d10-f2a3-4d4b-a5e7-2c1329af3c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1788891001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8dba6e-89f9-4f7a-b422-54e4b98ff682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379dee878e79445daff871608705a038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:29:12Z,use_quota=True,user_id='dfc23bb59eb24d60b266064559e809dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb8789e-99c4-46b4-96c7-ba8d8abbeedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb8789e-99c4-46b4-96c7-ba8d8abbeedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edccade6-87fd-409a-a37a-a68ff585ec8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edccade6-87fd-409a-a37a-a68ff585ec8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de8dba6e-89f9-4f7a-b422-54e4b98ff682', 'volume_name': 'volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8bac86-ea9a-46e5-b668-f4b0efdec8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8bac86-ea9a-46e5-b668-f4b0efdec8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c2fcfe-4662-4541-bc4f-ff74adfab017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume de8dba6e-89f9-4f7a-b422-54e4b98ff682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682', 'volume_size': 1}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9 1073741824" returned: 0 in 0.611s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:11 devstack sudo[90249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9
Apr 14 01:29:11 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.flows.manager.create_volume [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Flow 'volume_create_manager' (c8ce196c-2707-4b81-a9c3-24b4be551b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a505092a-d245-4633-99e9-b43e87221e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a505092a-d245-4633-99e9-b43e87221e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1984698226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efb3355-9362-407d-a54a-6123e94d0d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379dee878e79445daff871608705a038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:29:12Z,use_quota=True,user_id='dfc23bb59eb24d60b266064559e809dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806e7076-2de0-4342-bb2e-d4675363634e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806e7076-2de0-4342-bb2e-d4675363634e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:11 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56930af2-fe22-4d18-8517-2600e9e6805a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56930af2-fe22-4d18-8517-2600e9e6805a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1efb3355-9362-407d-a54a-6123e94d0d7a', 'volume_name': 'volume-1efb3355-9362-407d-a54a-6123e94d0d7a', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9af4d3-f5ee-43b8-87c2-167dba3700dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9af4d3-f5ee-43b8-87c2-167dba3700dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebff8e7-c688-4906-96e4-a7325baefe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:12 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume 1efb3355-9362-407d-a54a-6123e94d0d7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1efb3355-9362-407d-a54a-6123e94d0d7a', 'volume_size': 1}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-fc1f246f-6b6c-4461-842b-b2ada73a5624-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Lock "cinder-fc1f246f-6b6c-4461-842b-b2ada73a5624-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-quobyte-fc1f246f-6b6c-4461-842b-b2ada73a5624" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-fc1f246f-6b6c-4461-842b-b2ada73a5624" acquired by "delete_volume" :: waited 0.008s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b9a60b-0591-4a80-9da2-018ada872f8e]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:12 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624
Apr 14 01:29:12 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:12 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9" returned: 0 in 0.448s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.886s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-954864404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ca1c7f-50db-4237-a836-68151166608d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379dee878e79445daff871608705a038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:29:11Z,use_quota=True,user_id='dfc23bb59eb24d60b266064559e809dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Creating volume 94ca1c7f-50db-4237-a836-68151166608d {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:29:12 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-94ca1c7f-50db-4237-a836-68151166608d 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2173d6f6-a281-4016-ad49-8e144f7daa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29f5f2d-f88b-4361-a48a-3c56f2fdeccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:12 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-94ca1c7f-50db-4237-a836-68151166608d 1073741824
Apr 14 01:29:12 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:12 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9 (4e694f0d-d78b-43ef-bcdf-bf024d2dedc9): created successfully
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29f5f2d-f88b-4361-a48a-3c56f2fdeccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Flow 'volume_create_manager' (a4dffd24-b56a-435e-aae7-d3d418eb368d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:29:12 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-f052a52c-7bda-4bdc-b930-b2deccfa0a14 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Created volume successfully.
Apr 14 01:29:12 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624" returned: 0 in 0.471s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:12 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624
Apr 14 01:29:12 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:12 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-94ca1c7f-50db-4237-a836-68151166608d 1073741824" returned: 0 in 0.470s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:12 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-94ca1c7f-50db-4237-a836-68151166608d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:12 devstack sudo[90264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-94ca1c7f-50db-4237-a836-68151166608d
Apr 14 01:29:12 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:13 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-fc1f246f-6b6c-4461-842b-b2ada73a5624" returned: 0 in 0.444s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-fc1f246f-6b6c-4461-842b-b2ada73a5624" released by "delete_volume" :: held 0.944s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Created reservations ['2d7681de-dbe9-45b8-847d-2da3b5203848', '3e1d23ad-8cac-47d4-8bca-4ada936efb29', 'b492ae62-dffd-4316-9c84-8c3856ebc5f3', 'a728c449-8a3e-4dc7-82b0-992b91f6db2a'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:13 devstack sudo[90268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:29:13 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-1f33bfdd-1026-4088-ac67-e55237aeea6b-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:13 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-94ca1c7f-50db-4237-a836-68151166608d" returned: 0 in 0.446s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.660s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-415178671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab969c4-fdc5-4f83-a03b-1efdb9673987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379dee878e79445daff871608705a038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:29:11Z,use_quota=True,user_id='dfc23bb59eb24d60b266064559e809dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Creating volume aab969c4-fdc5-4f83-a03b-1efdb9673987 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:29:13 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aab969c4-fdc5-4f83-a03b-1efdb9673987 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6359f2ac-2f8a-4c5f-8b71-c70e8a898135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ca1c7f-50db-4237-a836-68151166608d', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be33d114-f090-43dd-aa05-e8253177cdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:13 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aab969c4-fdc5-4f83-a03b-1efdb9673987 1073741824
Apr 14 01:29:13 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Lock "cinder-1f33bfdd-1026-4088-ac67-e55237aeea6b-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:13 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume volume-94ca1c7f-50db-4237-a836-68151166608d (94ca1c7f-50db-4237-a836-68151166608d): created successfully
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be33d114-f090-43dd-aa05-e8253177cdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Flow 'volume_create_manager' (d4e64ae1-73ba-454b-8429-c41cf0775d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:29:13 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-bc7bfbde-86e3-41db-8dc7-c75b57269310 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Created volume successfully.
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Acquiring lock "cinder-quobyte-1f33bfdd-1026-4088-ac67-e55237aeea6b" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-1f33bfdd-1026-4088-ac67-e55237aeea6b" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2798ac9a-70dc-4098-b43d-c7f0dbd5920b]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:13 devstack sudo[90272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b
Apr 14 01:29:13 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:13 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.507s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:29:13 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Deleted volume successfully.
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-d32983b1-3448-4eae-b11d-209ccb505bb8 tempest-VolumeDependencyTests-194334341 None] Lock "cinder-fc1f246f-6b6c-4461-842b-b2ada73a5624-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:13 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aab969c4-fdc5-4f83-a03b-1efdb9673987 1073741824" returned: 0 in 0.475s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aab969c4-fdc5-4f83-a03b-1efdb9673987 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:13 devstack sudo[90279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aab969c4-fdc5-4f83-a03b-1efdb9673987
Apr 14 01:29:13 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:13 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b" returned: 0 in 0.502s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:13 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:13 devstack sudo[90283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b
Apr 14 01:29:13 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:14 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aab969c4-fdc5-4f83-a03b-1efdb9673987" returned: 0 in 0.427s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.371s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1788891001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8dba6e-89f9-4f7a-b422-54e4b98ff682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379dee878e79445daff871608705a038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:29:12Z,use_quota=True,user_id='dfc23bb59eb24d60b266064559e809dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Creating volume de8dba6e-89f9-4f7a-b422-54e4b98ff682 {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:29:14 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a823cad-8019-477b-afda-f2220f802d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aab969c4-fdc5-4f83-a03b-1efdb9673987', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6104b9d-2df4-4544-8ebc-47010eee56fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:14 devstack sudo[90287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682 1073741824
Apr 14 01:29:14 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:14 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume volume-aab969c4-fdc5-4f83-a03b-1efdb9673987 (aab969c4-fdc5-4f83-a03b-1efdb9673987): created successfully
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6104b9d-2df4-4544-8ebc-47010eee56fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Flow 'volume_create_manager' (5c07d54f-7386-4d6f-ad6c-0ff21234c2ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:29:14 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-009a5ee4-cd0c-4b16-b77f-d7ae611513a5 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Created volume successfully.
Apr 14 01:29:14 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1f33bfdd-1026-4088-ac67-e55237aeea6b" returned: 0 in 0.458s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Lock "cinder-quobyte-1f33bfdd-1026-4088-ac67-e55237aeea6b" released by "delete_volume" :: held 0.980s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Created reservations ['730ca40d-6388-4bbc-97e7-3d2b691956a5', '7c37fd40-883a-4ce4-ac49-72b22d526175', 'd85cc434-4946-4f58-9fd7-3c72fd929cd9', '3d8113a7-e0ca-480f-bf43-c3637e9f8b93'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:14 devstack sudo[90289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:29:14 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:14 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682 1073741824" returned: 0 in 0.496s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:14 devstack sudo[90295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682
Apr 14 01:29:14 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:14 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.416s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:29:14 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Deleted volume successfully.
Apr 14 01:29:14 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-c7e48729-a6f1-480f-a5d3-c680b5795aee tempest-VolumeDependencyTests-194334341 None] Lock "cinder-1f33bfdd-1026-4088-ac67-e55237aeea6b-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:15 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682" returned: 0 in 0.413s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.092s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f70e020fcd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T23:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1984698226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efb3355-9362-407d-a54a-6123e94d0d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379dee878e79445daff871608705a038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T23:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T23:29:12Z,use_quota=True,user_id='dfc23bb59eb24d60b266064559e809dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbabc65-4447-4e16-b148-16762f6c7a95),volume_type_id=5fbabc65-4447-4e16-b148-16762f6c7a95)}" {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.remotefs [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Creating volume 1efb3355-9362-407d-a54a-6123e94d0d7a {{(pid=81812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Selected osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45 as target Quobyte volume. {{(pid=81812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 14 01:29:15 devstack cinder-volume[81812]: INFO cinder.volume.drivers.remotefs [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] casted to osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1efb3355-9362-407d-a54a-6123e94d0d7a 1073741824 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c2fcfe-4662-4541-bc4f-ff74adfab017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f533695d-144e-44ee-a20d-3f7aa0c07dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:15 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1efb3355-9362-407d-a54a-6123e94d0d7a 1073741824
Apr 14 01:29:15 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:15 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682 (de8dba6e-89f9-4f7a-b422-54e4b98ff682): created successfully
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f533695d-144e-44ee-a20d-3f7aa0c07dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Flow 'volume_create_manager' (a8f8334d-03b2-4041-b4ae-281998d60022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:29:15 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-d5f38a49-a8a3-4176-ab27-7fd24c38fb19 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Created volume successfully.
Apr 14 01:29:15 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1efb3355-9362-407d-a54a-6123e94d0d7a 1073741824" returned: 0 in 0.536s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:15 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1efb3355-9362-407d-a54a-6123e94d0d7a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:15 devstack sudo[90337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1efb3355-9362-407d-a54a-6123e94d0d7a
Apr 14 01:29:15 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:16 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1efb3355-9362-407d-a54a-6123e94d0d7a" returned: 0 in 0.490s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'} {{(pid=81812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebff8e7-c688-4906-96e4-a7325baefe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1efb3355-9362-407d-a54a-6123e94d0d7a', 'volume_size': 1}' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0a49db-3f36-4e4d-b036-60f1dc4579d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 14 01:29:16 devstack cinder-volume[81812]: INFO cinder.volume.flows.manager.create_volume [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Volume volume-1efb3355-9362-407d-a54a-6123e94d0d7a (1efb3355-9362-407d-a54a-6123e94d0d7a): created successfully
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0a49db-3f36-4e4d-b036-60f1dc4579d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81812) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Flow 'volume_create_manager' (c8ce196c-2707-4b81-a9c3-24b4be551b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81812) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 14 01:29:16 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-4319024e-7a2a-4d60-bbaa-b9fa547eaecb tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Created volume successfully.
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "cinder-1efb3355-9362-407d-a54a-6123e94d0d7a-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-1efb3355-9362-407d-a54a-6123e94d0d7a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "cinder-quobyte-1efb3355-9362-407d-a54a-6123e94d0d7a" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-quobyte-1efb3355-9362-407d-a54a-6123e94d0d7a" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bb9ddb-1444-4a38-9b4b-3587d7809bf1]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1efb3355-9362-407d-a54a-6123e94d0d7a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:16 devstack sudo[90340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1efb3355-9362-407d-a54a-6123e94d0d7a
Apr 14 01:29:16 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:16 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1efb3355-9362-407d-a54a-6123e94d0d7a" returned: 0 in 0.490s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:16 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1efb3355-9362-407d-a54a-6123e94d0d7a {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:16 devstack sudo[90345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1efb3355-9362-407d-a54a-6123e94d0d7a
Apr 14 01:29:16 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:17 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-1efb3355-9362-407d-a54a-6123e94d0d7a" returned: 0 in 0.402s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-quobyte-1efb3355-9362-407d-a54a-6123e94d0d7a" released by "delete_volume" :: held 0.919s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Created reservations ['90f024ac-4844-461f-918e-3aade434ba86', 'c54edcb0-4b43-49bc-aade-df64a8b20163', 'bc5eb321-d876-43e6-8acb-91735d9fddf8', 'f5843ff1-d1ed-497c-87d9-5771d4ccfb9e'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:17 devstack sudo[90348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:29:17 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "cinder-de8dba6e-89f9-4f7a-b422-54e4b98ff682-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-de8dba6e-89f9-4f7a-b422-54e4b98ff682-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "cinder-quobyte-de8dba6e-89f9-4f7a-b422-54e4b98ff682" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-quobyte-de8dba6e-89f9-4f7a-b422-54e4b98ff682" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[380516b9-24e8-491e-a340-05d85e6aa71a]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:17 devstack sudo[90351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682
Apr 14 01:29:17 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:17 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.447s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:29:17 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Deleted volume successfully.
Apr 14 01:29:17 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-9a1fb951-8202-426e-a677-6849cfbfe9b1 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-1efb3355-9362-407d-a54a-6123e94d0d7a-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:18 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682" returned: 0 in 0.467s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:18 devstack sudo[90357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682
Apr 14 01:29:18 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:18 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-de8dba6e-89f9-4f7a-b422-54e4b98ff682" returned: 0 in 0.404s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-quobyte-de8dba6e-89f9-4f7a-b422-54e4b98ff682" released by "delete_volume" :: held 0.900s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Created reservations ['22f0355b-edc5-47c3-8ea8-ed81754b0a91', '515def51-a445-4a85-abcc-93997db67fa0', '12d44c13-79f2-476d-9834-2376c185ed2d', '6f16c2d3-51a6-4bf2-a84d-c02992073fb6'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:18 devstack sudo[90360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:29:18 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "cinder-aab969c4-fdc5-4f83-a03b-1efdb9673987-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-aab969c4-fdc5-4f83-a03b-1efdb9673987-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "cinder-quobyte-aab969c4-fdc5-4f83-a03b-1efdb9673987" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-quobyte-aab969c4-fdc5-4f83-a03b-1efdb9673987" acquired by "delete_volume" :: waited 0.007s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ade048-1d63-4f2e-a8c0-44345455b247]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aab969c4-fdc5-4f83-a03b-1efdb9673987 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:18 devstack sudo[90362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aab969c4-fdc5-4f83-a03b-1efdb9673987
Apr 14 01:29:18 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:18 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.430s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:29:18 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Deleted volume successfully.
Apr 14 01:29:18 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-a6a33333-ff3d-423f-aa16-f4fee86ad183 tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-de8dba6e-89f9-4f7a-b422-54e4b98ff682-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:19 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aab969c4-fdc5-4f83-a03b-1efdb9673987" returned: 0 in 0.486s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aab969c4-fdc5-4f83-a03b-1efdb9673987 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:19 devstack sudo[90368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aab969c4-fdc5-4f83-a03b-1efdb9673987
Apr 14 01:29:19 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:19 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-aab969c4-fdc5-4f83-a03b-1efdb9673987" returned: 0 in 0.426s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-quobyte-aab969c4-fdc5-4f83-a03b-1efdb9673987" released by "delete_volume" :: held 0.931s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Created reservations ['d767d63d-a338-4a29-ae86-fe16190600b3', 'f01b94e0-c1d4-4006-b06d-f54e0f9e36a5', 'a220a005-a659-4874-86e1-4d83d311f5d6', 'ee0242e4-0f54-4134-996d-dfb4befd2b48'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:19 devstack sudo[90371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:29:19 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "cinder-94ca1c7f-50db-4237-a836-68151166608d-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-94ca1c7f-50db-4237-a836-68151166608d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "cinder-quobyte-94ca1c7f-50db-4237-a836-68151166608d" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-quobyte-94ca1c7f-50db-4237-a836-68151166608d" acquired by "delete_volume" :: waited 0.010s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db96150-d123-47c4-ad3e-05db789e156f]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:19 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-94ca1c7f-50db-4237-a836-68151166608d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:19 devstack sudo[90373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-94ca1c7f-50db-4237-a836-68151166608d
Apr 14 01:29:19 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:20 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.421s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:29:20 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Deleted volume successfully.
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-7b4af957-5aa3-4d64-8aee-ecb625fab64e tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-aab969c4-fdc5-4f83-a03b-1efdb9673987-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:20 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-94ca1c7f-50db-4237-a836-68151166608d" returned: 0 in 0.477s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-94ca1c7f-50db-4237-a836-68151166608d {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:20 devstack sudo[90379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-94ca1c7f-50db-4237-a836-68151166608d
Apr 14 01:29:20 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:20 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-94ca1c7f-50db-4237-a836-68151166608d" returned: 0 in 0.420s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-quobyte-94ca1c7f-50db-4237-a836-68151166608d" released by "delete_volume" :: held 0.928s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Created reservations ['63155713-9b94-4ebf-a28c-06ba8bceaee9', '445e956f-d072-4f53-a3f6-81f45b194eba', '0ae486e4-885b-4b3e-b595-7ce24ed161a2', '45131c7b-3b0c-4ff8-a6da-067e844cf15e'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:20 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:29:20 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "cinder-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "cinder-quobyte-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-quobyte-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9" acquired by "delete_volume" :: waited 0.006s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d9d562-1b32-4685-aec8-03b32628a133]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:20 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:21 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9
Apr 14 01:29:21 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:21 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.436s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:29:21 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Deleted volume successfully.
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-3d03e4ae-4768-4ae6-9d42-29ae91db856d tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-94ca1c7f-50db-4237-a836-68151166608d-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:21 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9" returned: 0 in 0.467s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9 {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:21 devstack sudo[90390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9
Apr 14 01:29:21 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:21 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9" returned: 0 in 0.407s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-quobyte-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9" released by "delete_volume" :: held 0.896s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Created reservations ['f51a4271-28f7-4c73-91c3-93bb37583819', '34ede805-6107-4738-8881-9f775343a81e', '5a694d7b-8dbc-4442-92fd-7a926138b882', 'fa936433-49a3-4f10-ac9d-76c015deaa6d'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:21 devstack sudo[90393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:29:21 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "cinder-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce-delete_volume" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:21 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "cinder-quobyte-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce" by "delete_volume" {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-quobyte-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce" acquired by "delete_volume" :: waited 0.017s {{(pid=81812) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG oslo.privsep.daemon [-] privsep: reply[267eaaf0-139b-43c0-af1b-cb778d0ada46]: (4, 'qcow2') {{(pid=82599) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:22 devstack sudo[90395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce
Apr 14 01:29:22 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:22 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.432s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:29:22 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Deleted volume successfully.
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-0e53da78-9c53-411f-8a2a-78a7caf293de tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-4e694f0d-d78b-43ef-bcdf-bf024d2dedc9-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:22 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce" returned: 0 in 0.465s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:22 devstack sudo[90401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce
Apr 14 01:29:22 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:22 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf/volume-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce" returned: 0 in 0.408s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-quobyte-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce" released by "delete_volume" :: held 0.894s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG cinder.quota [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Created reservations ['395bebac-fb6e-4b56-b473-c4d6455268d6', 'a48c1be3-72ad-4c7c-9cd5-934f988d2be1', '034c011a-d95b-4ae2-8ea2-8df23a513b87', '5c661865-86f5-497e-957c-908adfc59e83'] {{(pid=81812) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45': None} {{(pid=81812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG cinder.volume.drivers.quobyte [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1990a51e-30ce-49fa-925c-2fc0b18b9f45'] {{(pid=81812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.lockutils [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81812) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 14 01:29:22 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 14 01:29:23 devstack sudo[90404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf
Apr 14 01:29:23 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 14 01:29:23 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root
Apr 14 01:29:23 devstack cinder-volume[81812]: DEBUG oslo_concurrency.processutils [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d139c30bb8c2192c878952605c9bcf" returned: 0 in 0.432s {{(pid=81812) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 14 01:29:23 devstack cinder-volume[81812]: DEBUG cinder.manager [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Notifying Schedulers of capabilities ... {{(pid=81812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 14 01:29:23 devstack cinder-volume[81812]: INFO cinder.volume.manager [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Deleted volume successfully.
Apr 14 01:29:23 devstack cinder-volume[81812]: DEBUG cinder.coordination [None req-e1bc49c4-9a3a-4b9a-a188-5ace385fd9ac tempest-CreateVolumesFromSourceVolumeTest-1758919029 None] Lock "cinder-f6dd2c18-9bdf-418e-981e-2aea1a1dcbce-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=81812) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 14 01:29:32 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:SELECT=136,cinder:UPDATE=195,cinder:INSERT=61,cinder:DELETE=13 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 14 01:29:33 devstack cinder-volume[81812]: DEBUG dbcounter [-] [81812] Writing DB stats cinder:DELETE=19,cinder:SELECT=149,cinder:UPDATE=210,cinder:INSERT=41 {{(pid=81812) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}